[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [csmith-dev] Checksum, different options

On 12/09/11 16:10, John Regehr wrote:
Hi Paulo,

Pascal's suggestions are all excellent.

The problem that you now face is testcase reduction. You can approach
this by hand (and I recommend that you do this for the first few bugs)
but there are also partially automated solutions:


Thanks for the suggestion, John! I am already using delta.

The key is that you need to run a tool like Pascal's or Chucky's inside
the Delta test script. Otherwise, undefined behavior is almost always
added by Delta.

The Delta test scripts that I personally use have gotten pretty baroque,
unfortunately. They look for a lot of compiler warnings, run Valgrind,
and as a last resort run a more expensive tool like KCC/Frama-C.

However, I am not using KCC or Frama-C, or valgrind.
My delta script just checks in the compiler succeds to compile and executable returns the expected checksums.

The reason why I asked Pascal about using Frama-C was exactly with the intent to integrate it into my test case reduction scripts.



Member of the CSR plc group of companies. CSR plc registered in England and Wales, registered number 4187346, registered office Churchill House, Cambridge Business Park, Cowley Road, Cambridge, CB4 0WZ, United Kingdom
More information can be found at www.csr.com. Follow CSR on Twitter at http://twitter.com/CSR_PLC and read our blog at www.csr.com/blog