Lessons from implementing a software metrics program

Software process improvement is seen by many as a viable strategy for overcoming the software crisis. It is, however, difficult to determine the actual effect of such improvement efforts. This paper reports from an organization that is implementing a software metrics program with the expressed purpose of measuring the effects of their improvement project. The metrics program is intended to measure key indicators of all completed projects and to summarize progress information in a quarterly management report. The paper describes important events during the implementation of this metrics program. The process turned out to be long and complex, and the software organization found itself confronted with dilemmas based on contradictory demands and value conflicts. The paper interprets the implementation process from two complementary perspectives. First, it is viewed as an additional engineering process in which a metrics program is constructed and put to use. Second, it is seen as an evolutionary cultivation process in which the basic values of the software organization are confronted and transformed. This analysis leads to practical advice on how to implement metrics programs as part of software management practices.

[1]  Lars Mathiassen,et al.  Using Computers in Qualitative Research , 1991 .

[2]  Lionel C. Briand,et al.  Practical guidelines for measurement-based process improvement , 1996, Softw. Process. Improv. Pract..

[3]  Robert B. Grady,et al.  Practical Software Metrics for Project Management and Process Improvement , 1992 .

[4]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[5]  Donald A. Sch.  The reflective practitioner: how professionals think in action , 1983 .

[6]  Michael Foster.  An Introduction to the Theory and Practice of Action Research in Work Organizations , 1972 .

[7]  R. Kaplan,et al.  strategic learning & the balanced scorecard , 1996 .

[8]  Lars Mathiassen,et al.  Lessons Learned in a National SPI Effort , 1998 .

[9]  Khaled El Emam,et al.  Fraunhofer Institute for Experimental Software Engineering , 1997, Softw. Process. Improv. Pract..

[10]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[11]  Elizabeth K. Bailey,et al.  Software Measurement for DoD Systems: Recommendations for Initial Core Measures. , 1992 .

[12]  J. Brown,et al.  Organizational Learning and Communities-of-Practice: Toward a Unified View of Working, Learning, and Innovation , 1991 .

[13]  Khaled El Emam,et al.  Costs and Benefits of Software Process Improvement , 1997 .

[14]  Stan Rifkin,et al.  Software Engineering Process Group Guide , 1990 .

[15]  J. March,et al.  Information in Organizations as Signal and Symbol. , 1981 .

[16]  Lars Mathiassen,et al.  The future of our profession , 1997, CACM.

[17]  Lars Mathiassen,et al.  Reflective Systems Development , 1998, Scand. J. Inf. Syst..

[18]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[19]  J. Nunamaker.  Proceedings of the 53rd Hawaii International Conference on System Sciences , 1999 .

[20]  C. Ciborra,et al.  Formative contexts and information technology: Understanding the dynamics of innovation in organizations , 1994 .

[21]  M. Lynn.  Hawaii International Conference on System Sciences , 1996 .

[22]  Lars Mathiassen,et al.  Engineering and Cultivation of a Metrics Programme , 1999 .

[23]  Karen D. Prenger,et al.  Costs and Benefits of Software Process Improvement , 1997 .

[24]  Jan Pries-Heje,et al.  Combining quantitative and qualitative assessment methods in software process improvement , 1998, ECIS.

[25]  David P. Norton,et al.  Strategic Learning and the Balanced Scorecard , 1996 .

[26]  Victor R. Basili,et al.  A Methodology for Collecting Valid Software Engineering Data , 1984, IEEE Transactions on Software Engineering.

[27]  Robert B. Grady,et al.  Successful Software Process Improvement , 1997 .

[28]  Donald A. Schön,et al.  Organizational Learning: A Theory Of Action Perspective , 1978 .