TechRxiv
TSE_2020.pdf (710.42 kB)

Better Prediction of Mutation Score

Download (710.42 kB)
preprint
posted on 14.07.2021, 14:30 by Yossi Gil, Dor Ma’ayan

Mutation score is widely accepted to be a reliable measurement for the effectiveness of software tests. Recent studies, however, show that mutation analysis is extremely costly and hard to use in practice. We present a novel direct prediction model of mutation score using neural networks. Relying solely on static code features that do not require generation of mutants or execution of the tests, we predict mutation score with an accuracy better than a quintile. When we include statement coverage as a feature, our accuracy rises to about a decile. Using a similar approach, we also improve the state-of-the-art results for binary test effectiveness prediction and introduce an intuitive, easy-to-calculate set of features superior to previously studied sets. We also publish the largest dataset of test-class level mutation score and static code features data to date, for future research. Finally, we discuss how our approach could be integrated into real-world systems, IDEs, CI tools, and testing frameworks.

History

Email Address of Submitting Author

Dor.d.ma@gmail.com

ORCID of Submitting Author

0000-0002-7290-2789

Submitting Author's Institution

Technion

Submitting Author's Country

Israel

Usage metrics

Licence

Exports