[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [xsmith-dev] Early Dafny Results (Re: XSmith questions)

Sorawee Porncharoenwase <sorawee.pwase@gmail.com> writes:

> There are also a lot more bugs discovered related to multiset with zero
> multiplicity. The bugs are scattered in several functions, but they all stem
> from misunderstanding the invariant of the data structure, so I don't know
> how to count the number of bugs properly. Perhaps we should count it as one
> for each affected language?

A popular metric for counting unique bugs is "correcting commit."

(Which of course can be gamed, but still, it has the advantages of being
"standard" and automatably countable and up to the system maintainer, not the
person counting the bugs.)

Eric Eide <eeide@cs.utah.edu>   .        University of Utah School of Computing
https://www.cs.utah.edu/~eeide/ . +1 801-585-5512 .   Salt Lake City, Utah, USA