How Does a Measurement Programme Evolve in Software Organizations?

Establishing a software measurement programme within an organization is not a straightforward task. Previous literature surveys have focused on software process improvement in general and software measurement has been analysed in case studies. This literature survey collects the data from separate cases and presents the critical success factors that are specific to software measurement programmes. We present a categorization of the success factors based on organizational roles that are involved in measurement. Furthermore, the most essential elements of success in different phases of the life cycle of the measurement programme are analysed. It seems that the role of upper management is crucial when starting measurement and the individual developers' impact increases in the later phases. Utilization of the measurement data and improvement of the measurement and development processes requires active management support again.

[1]  Patrik Berander,et al.  A goal question metric based approach for efficient measurement framework definition , 2006, ISESE '06.

[2]  Eric W. Stein,et al.  Organization memory: Review of concepts and recommendations for management , 1995 .

[3]  Norman E. Fenton,et al.  Implementing Effective Software Metrics Programs , 1997, IEEE Softw..

[4]  Mayuram S. Krishnan,et al.  The impact of institutional forces on software metrics programs , 2005, IEEE Transactions on Software Engineering.

[5]  Qin Zhang,et al.  Improving software development management through software project telemetry , 2005, IEEE Software.

[6]  James D. Herbsleb,et al.  Conceptual simplicity meets organizational complexity: case study of a corporate metrics program , 1998, Proceedings of the 20th International Conference on Software Engineering.

[7]  Tore Dybå,et al.  An empirical investigation of the key factors for success in software process improvement , 2005, IEEE Transactions on Software Engineering.

[8]  Markku Oivo,et al.  Adopting GQM-Based Measurement in an Industrial Environment , 1998, IEEE Softw..

[9]  Stephen H. Kan,et al.  Metrics and Models in Software Quality Engineering , 1994, SOEN.

[10]  E. Rogers.  Diffusion of Innovations , 1962 .

[11]  Hans van Vliet,et al.  Measurements should generate value, rather than data [software metrics] , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[12]  Austen Rainer,et al.  A quantitative and qualitative analysis of factors affecting software processes , 2003, J. Syst. Softw..

[13]  Hans van Vliet,et al.  Measurements Should Generate Value, Rather than Data , 1999 .

[14]  Victor R. Basili,et al.  Validation on an Approach for Improving Existing Measurement Frameworks , 2000, IEEE Trans. Software Eng..

[15]  Hans van Vliet,et al.  Measurement program success factors revisited , 2001, Inf. Softw. Technol..

[16]  D. Ross Jeffery,et al.  An Instrument for Assessing Software Measurement Programs , 2000, Empirical Software Engineering.

[17]  Lionel C. Briand,et al.  Practical guidelines for measurement-based process improvement , 1996, Softw. Process. Improv. Pract..

[18]  Charles C. Manz,et al.  An Organizational Memory Approach to Information Management , 1998 .

[19]  D. Ross Jeffery,et al.  Lessons learnt from the analysis of large-scale corporate databases , 2006, ICSE.

[20]  Lars Mathiassen,et al.  Information-centric assessment of software metrics practices , 2005, IEEE Transactions on Engineering Management.

[21]  Jürgen Münch,et al.  GQM^+ Strategies -- Aligning Business Strategies with Software Measurement , 2007, ESEM 2007.

[22]  John J. Marciniak,et al.  Encyclopedia of Software Engineering , 1994, Encyclopedia of Software Engineering.

[23]  Shari Lawrence Pfleeger,et al.  Lessons learned in building a corporate metrics program , 1993, IEEE Software.

[24]  Victor R. Basili,et al.  A Methodology for Collecting Valid Software Engineering Data , 1984, IEEE Transactions on Software Engineering.

[25]  Norman E. Fenton,et al.  Software metrics: roadmap , 2000, ICSE '00.

[26]  Michael Daskalantonakis,et al.  A Practical View of Software Measurement and Implementation Experiences Within Motorola , 1992, IEEE Trans. Software Eng..

[27]  Lars Mathiassen,et al.  Cultivation and engineering of a software metrics program , 2003, Inf. Syst. J..