[xsmith-dev] Early Dafny Results (Re: XSmith questions)

Eric Eide eeide at cs.utah.edu
Thu Sep 2 21:00:10 MDT 2021


Sorawee Porncharoenwase <sorawee.pwase at gmail.com> writes:

> There are also a lot more bugs discovered related to multiset with zero
> multiplicity. The bugs are scattered in several functions, but they all stem
> from misunderstanding the invariant of the data structure, so I don't know
> how to count the number of bugs properly. Perhaps we should count it as one
> for each affected language?

A popular metric for counting unique bugs is "correcting commit."

(Which of course can be gamed, but still, it has the advantages of being
"standard" and automatably countable and up to the system maintainer, not the
person counting the bugs.)

-- 
-------------------------------------------------------------------------------
Eric Eide <eeide at cs.utah.edu>   .        University of Utah School of Computing
https://www.cs.utah.edu/~eeide/ . +1 801-585-5512 .   Salt Lake City, Utah, USA



More information about the xsmith-dev mailing list