[creduce-bugs] Possible bug in pass statistics

[regehr at cs.utah.edu (John Regehr)]

Thanks!  I will look into it.

John



On 09/22/2012 08:00 AM, Konstantin Tokarev wrote:
> After test case reduction I've got following statistics:
>
> pass statistics:
>    method pass_blank :: 0 worked 2 times and failed 0 times
>    method pass_lines :: 0 worked 155 times and failed 4950 times
>    method pass_lines :: 0 worked 155 times and failed 4950 times
>    method pass_lines :: 0 worked 155 times and failed 4950 times
>    method pass_clang :: remove-trivial-base-template worked 0 times and failed 0 times
>    method pass_clang :: class-template-to-class worked 0 times and failed 0 times
>    method pass_clang :: remove-base-class worked 0 times and failed 0 times
>    method pass_clang :: replace-derived-class worked 0 times and failed 0 times
>    method pass_clang :: remove-unresolved-base worked 0 times and failed 0 times
>    method pass_clang :: remove-ctor-initializer worked 0 times and failed 0 times
>    method pass_clang :: empty-struct-to-int worked 0 times and failed 0 times
>    method pass_clang :: remove-pointer worked 0 times and failed 0 times
>    method pass_clang :: remove-array worked 0 times and failed 0 times
>    method pass_clang :: remove-addr-taken worked 0 times and failed 0 times
>    method pass_clang :: combine-global-var worked 0 times and failed 0 times
>    method pass_clang :: combine-local-var worked 0 times and failed 0 times
>    method pass_clang :: simplify-struct-union-decl worked 0 times and failed 0 times
>    method pass_clang :: move-global-var worked 0 times and failed 0 times
>    method pass_clang :: unify-function-decl worked 0 times and failed 0 times
>    method pass_peep :: a worked 0 times and failed 69 times
>    method pass_peep :: b worked 14 times and failed 383 times
>    method pass_ints :: a worked 0 times and failed 0 times
>    method pass_ints :: b worked 0 times and failed 0 times
>    method pass_ints :: c worked 0 times and failed 0 times
>    method pass_ints :: d worked 0 times and failed 0 times
>    method pass_ints :: e worked 0 times and failed 0 times
>    method pass_indent :: regular worked 3 times and failed 0 times
>    method pass_indent :: final worked 1 times and failed 0 times
>    method pass_balanced :: parens-only worked 3 times and failed 19 times
>    method pass_balanced :: angles-only worked 0 times and failed 0 times
>    method pass_clang :: remove-namespace worked 2 times and failed 0 times
>    method pass_clang :: aggregate-to-scalar worked 0 times and failed 0 times
>    method pass_clang :: local-to-global worked 0 times and failed 0 times
>    method pass_clang :: param-to-global worked 1 times and failed 6 times
>    method pass_clang :: param-to-local worked 0 times and failed 6 times
>    method pass_clang :: remove-nested-function worked 0 times and failed 0 times
>    method pass_clang :: rename-fun worked 0 times and failed 1 times
>    method pass_clang :: union-to-struct worked 0 times and failed 0 times
>    method pass_clang :: rename-param worked 0 times and failed 0 times
>    method pass_clang :: rename-var worked 0 times and failed 0 times
>    method pass_clang :: rename-class worked 1 times and failed 0 times
>    method pass_clang :: return-void worked 0 times and failed 3 times
>    method pass_clang :: simple-inliner worked 0 times and failed 0 times
>    method pass_clang :: reduce-pointer-level worked 1 times and failed 6 times
>    method pass_clang :: lift-assignment-expr worked 0 times and failed 0 times
>    method pass_clang :: copy-propagation worked 0 times and failed 0 times
>    method pass_clang :: callexpr-to-value worked 0 times and failed 4 times
>    method pass_clang :: replace-callexpr worked 0 times and failed 0 times
>    method pass_clang :: simplify-callexpr worked 0 times and failed 4 times
>    method pass_clang :: remove-unused-function worked 203 times and failed 747 times
>    method pass_clang :: remove-unused-function worked 203 times and failed 747 times
>    method pass_clang :: remove-unused-var worked 1 times and failed 0 times
>    method pass_clang :: simplify-if worked 1 times and failed 0 times
>    method pass_clang :: reduce-array-dim worked 0 times and failed 0 times
>    method pass_clang :: reduce-array-size worked 0 times and failed 0 times
>    method pass_clang :: move-function-body worked 0 times and failed 0 times
>    method pass_clang :: simplify-comma-expr worked 0 times and failed 0 times
>    method pass_clang :: simplify-dependent-typedef worked 0 times and failed 0 times
>    method pass_clang :: replace-simple-typedef worked 0 times and failed 0 times
>    method pass_clang :: remove-unused-field worked 1 times and failed 0 times
>    method pass_clang :: reduce-class-template-param worked 0 times and failed 0 times
>    method pass_lines :: 1 worked 346 times and failed 15619 times
>    method pass_lines :: 1 worked 346 times and failed 15619 times
>    method pass_lines :: 1 worked 346 times and failed 15619 times
>    method pass_lines :: 2 worked 217 times and failed 1702 times
>    method pass_lines :: 2 worked 217 times and failed 1702 times
>    method pass_lines :: 2 worked 217 times and failed 1702 times
>    method pass_lines :: 10 worked 28 times and failed 248 times
>    method pass_lines :: 10 worked 28 times and failed 248 times
>    method pass_lines :: 10 worked 28 times and failed 248 times
>    method pass_crc ::  worked 0 times and failed 0 times
>    method pass_ternary :: b worked 0 times and failed 0 times
>    method pass_ternary :: c worked 0 times and failed 0 times
>    method pass_balanced :: curly worked 0 times and failed 18 times
>    method pass_balanced :: curly2 worked 0 times and failed 18 times
>    method pass_balanced :: curly3 worked 0 times and failed 0 times
>    method pass_balanced :: parens worked 1 times and failed 24 times
>    method pass_balanced :: angles worked 0 times and failed 0 times
>    method pass_balanced :: curly-only worked 3 times and failed 14 times
>
>
> You can see 3 identical lines "method pass_lines :: 0". However pass_lines 1, 2, and 10 were also used, but they are not mentioned at all.
>
> Git version: 58a414b
>