The Mutation Testing Coupling Hypothesis

The mutation testing coupling hypothesis DeMilloLS78 says if a test suite is good enough to detect all first order mutants, it will detect ``a large percentage'' of higher order mutants (Offutt92, page 6).

Demonstration of the Coupling Hypothesis

triangle.c 1st,2nd Order Comparison Mutants

16383 test suites were generated by selectively including parts of the triangle test suite. Test suites that kill more first order mutants tend to kill more higher order mutants.

Not only does the graph support the coupling hypothesis, it shows that there can be a strong (non-linear) relationship between how effective a test suite at detecting first order mutants and how effective it is against higher order mutants


W. B. Langdon
CREST
Department of Computer Science,
King's College London,
Strand, London, WC2R 2LS

27 May 2010