Bitte benutzen Sie diese Kennung, um auf die Ressource zu verweisen: http://dx.doi.org/10.18419/opus-8944
Autor(en): Niedermayr, Rainer
Juergens, Elmar
Wagner, Stefan
Titel: Will my tests tell me if I break this code?
Erscheinungsdatum: 2016
Dokumentart: Konferenzbeitrag
Konferenz: International Workshop on Continuous Software Evolution and Delivery (2016, Austin,Tex.)
Erschienen in: Proceedings of the International Workshop on Continuous Software Evolution and Delivery : CSED '16. New York, NY : ACM, 2016. - ISBN 978-1-4503-4157-8, S. 23-29
URI: http://elib.uni-stuttgart.de/handle/11682/8961
http://nbn-resolving.de/urn:nbn:de:bsz:93-opus-ds-89612
http://dx.doi.org/10.18419/opus-8944
ISBN: 978-1-4503-4157-8
Bemerkungen: Copyright ACM
Zusammenfassung: Automated tests play an important role in software evolution because they can rapidly detect faults introduced during changes. In practice, code-coverage metrics are often used as criteria to evaluate the effectiveness of test suites with focus on regression faults. However, code coverage only expresses which portion of a system has been executed by tests, but not how effective the tests actually are in detecting regression faults. Our goal was to evaluate the validity of code coverage as a measure for test effectiveness. To do so, we conducted an empirical study in which we applied an extreme mutation testing approach to analyze the tests of open-source projects written in Java. We assessed the ratio of pseudo-tested methods (those tested in a way such that faults would not be detected) to all covered methods and judged their impact on the software project. The results show that the ratio of pseudo-tested methods is acceptable for unit tests but not for system tests (that execute large portions of the whole system). Therefore, we conclude that the coverage metric is only a valid effectiveness indicator for unit tests.
Enthalten in den Sammlungen:05 Fakultät Informatik, Elektrotechnik und Informationstechnik

Dateien zu dieser Ressource:
Datei Beschreibung GrößeFormat 
Paper.pdf284,06 kBAdobe PDFÖffnen/Anzeigen


Alle Ressourcen in diesem Repositorium sind urheberrechtlich geschützt.