Assessing test suite effectiveness using static metrics

Open Access
Authors
Publication date 2017
Host editors
  • H. Osman
Book title Post-proceedings of the Tenth Seminar on Advanced Techniques and Tools for Software Evolution
Book subtitle Madrid, Spain, June 7-9, 2017
Series CEUR Workshop Proceedings
Event 10th Seminar on Advanced Techniques and Tools for Software Evolution, SATToSE 2017
Article number 3
Number of pages 24
Publisher Aachen: CEUR-WS
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract

With the increasing amount of automated tests, we need ways to measure the test eectiveness. The state-of-the-art technique for assessing test eectiveness, mutation testing, is too slow and cumbersome to be used in large scale evolution studies or code audits by external companies. In this paper we investigated two alternatives, namely code coverage and assertion count. We discovered that code coverage outperforms assertion count by showing a relation with test suite eec-tiveness for all analysed project. Assertion count only displays such a relation in only one of the analysed projects. Further analysing this relationship between assertion count coverage and test eectiveness would allow to circumvent some of the problems of mutation testing.

Document type Conference contribution
Language English
Published at https://ceur-ws.org/Vol-2070/paper-03.pdf
Other links https://ceur-ws.org/Vol-2070/ https://www.scopus.com/pages/publications/85045417698
Downloads
paper-03 (Final published version)
Permalink to this page
Back