Please use this identifier to cite or link to this item: http://dx.doi.org/10.18419/opus-8308
Authors: Lochmann, Klaus
Ramadani, Jasmin
Wagner, Stefan
Title: Are comprehensive quality models necessary for evaluating software quality?
Issue Date: 2013
metadata.ubs.publikation.typ: Konferenzbeitrag
metadata.ubs.publikation.source: Proceedings of the 9th International Conference on Predictive Models in Software Engineering (PROMISE'13). URL http://dx.doi.org/10.1145/2499393.2499404
URI: http://nbn-resolving.de/urn:nbn:de:bsz:93-opus-99199
http://elib.uni-stuttgart.de/handle/11682/8325
http://dx.doi.org/10.18419/opus-8308
metadata.ubs.bemerkung.extern: The presented work was partially funded by the German Federal Ministry of Education and Research (BMBF), grant "Quamoco, 01IS08023B".
Abstract: The concept of software quality is very complex and has many facets. Reflecting all these facets and at the same time measuring everything related to these facets results in comprehensive but large quality models and extensive measurements. In contrast, there are also many smaller, focused quality models claiming to evaluate quality with few measures. We investigate if and to what extent it is possible to build a focused quality model with similar evaluation results as a comprehensive quality model but with far less measures needed to be collected and, hence, reduced effort. We make quality evaluations with the comprehensive Quamoco base quality model and build focused quality models based on the same set of measures and data from over 2,000 open source systems. We analyse the ability of the focused model to predict the results of the Quamoco model by comparing them with a random predictor as a baseline. We calculate the standardised accuracy measure SA and effect sizes. We found that for the Quamoco model and its 378 automatically collected measures, we can build a focused model with only 10 measures but an accuracy of 61% and a medium to high effect size. We conclude that we can build focused quality models to get an impression of a system’s quality similar to comprehensive models. However, when including manually collected measures, the accuracy of the models stayed below 50%. Hence, manual measures seem to have a high impact and should therefore not be ignored in a focused model.
Appears in Collections:15 Fakultätsübergreifend / Sonstige Einrichtung

Files in This Item:
File Description SizeFormat 
light_weight_qm.pdf341,59 kBAdobe PDFView/Open


Items in OPUS are protected by copyright, with all rights reserved, unless otherwise indicated.