The doctoral dissertations of the former Helsinki University of Technology (TKK) and Aalto University Schools of Technology (CHEM, ELEC, ENG, SCI) published in electronic format are available in the electronic publications archive of Aalto University - Aaltodoc.
|
|
|
Quality Measurement and the Utilisation of Measurement Results in a Software Development Process
Jorma Hirvensalo
Dissertation for the degree of Doctor of Science in Technology to be presented with due permission of the Department of Electrical and Communications Engineering, for public examination and debate in Auditorium S4 at Helsinki University of Technology (Espoo, Finland) on the 11th of April, 2003, at 12 o'clock noon.
Dissertation in PDF format (ISBN 951-22-6424-2) [14966 KB]
Errata (in PDF format)
Dissertation is also available in print (ISBN 951-22-6423-4)
Abstract
The research topic of the thesis is quality measurement and the utilisation of measurement results in a software development process of a large switching system. The first problem studied, the utilisation, means that measurement results are poorly analysed; data is collected, but not enough conclusions are drawn about how that experience data could help in the planning and execution of software development projects. So, the problem is how to learn more about the collected material. The second research problem is further development of measurements from the point of view of the utilisation. We think this is because the existing metrics have too much focused on later phases instead of using purposeful driving metrics for controlling the process towards high final quality in early phases. The main objectives of this study are to examine the coupling of existing quality metrics to design practices, to generate new quality indicators, and to develop the utilisation of measurement results further. Basically, the study aims at finding out relationships between post-release measurement results and the driving attributes. It also aims at making proposals for methods to improve and introduce new measures; and to create a utilisation model for better use of measurement results. Research methods involve both empirical research and constructive design of models for measurement processes and utilisation. We apply statistical methods to sixteen data sets gathered from real software modules; and discuss correlation in the light of nineteen case studies. Eleven stated hypotheses are tested by their evidence based on the statistical analyses of the material collected during the 1990's from industrial projects. Generation of process and utilisation models is based on constructive modelling, on experience of good practices, and on adoption of elements from modern measurement theory as well as from goal- and attribute-oriented approaches. First, the results contribute to enhancement of empirical knowledge regarding implementation, problems, obstacles as well as lessons learnt on utilisation of measurements in an industrial environment. As a second result, the study provides analysed test results for each of the eleven hypotheses. A new result worth mentioning is a conclusion that 70-80 % of individual modules, which have been faultless in Function Test, are also faultless in System Test and during their first 6 months after delivery. Furthermore, the thesis presents an improved measurement framework including a renewed measurement process. The process is composed of four parts for planning, definition, performing - and especially - for utilising measurements. The thesis has also resulted in a novel utilisation model that can be used to improve the use of measurement results. Finally, we present a supplementary result that requires further research and validation. In particular, we have constructed a six-level measurement utilisation capability model.
Keywords: telecommunication switching, software quality, measurements, metrics, capability, maturity
This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
© 2003 Helsinki University of Technology
Last update 2011-05-26