The impact of institutional forces on software metrics programs

Software metrics programs are an important part of a software organization's productivity and quality initiatives as precursors to process-based improvement programs. Like other innovative practices, the implementation of metrics programs is prone to influences from the greater institutional environment the organization exists in. In this paper, we study the influence of both external and internal institutional forces on the assimilation of metrics programs in software organizations. We use previous case-based research in software metrics programs as well as prior work in institutional theory in proposing a model of metrics implementation. The theoretical model is tested on data collected through a survey from 214 metrics managers in defense-related and commercial software organizations. Our results show that external institutions, such as customers and competitors, and internal institutions, such as managers, directly influence the extent to which organizations change their internal work-processes around metrics programs. Additionally, the adaptation of work-processes leads to increased use of metrics programs in decision-making within the organization. Our research informs managers about the importance of management support and institutions in metrics programs adaptation. In addition, managers may note that the continued use of metrics information in decision-making is contingent on adapting the organization's work-processes around the metrics program. Without these investments in metrics program adaptation, the true business value in implementing metrics and software process improvement is not realized.

[1]  Lionel C. Briand,et al.  Practical guidelines for measurement-based process improvement , 1996, Softw. Process. Improv. Pract..

[2]  Mayuram S. Krishnan,et al.  Measurement Programs in Software Development: Determinants of Success , 2002, IEEE Trans. Software Eng..

[3]  Rekha Jain,et al.  Lessons from India. , 1990 .

[4]  Mark C. Paulk,et al.  Analyzing the Conceptual Relationship Between ISO/IEC 15504 (Software Process Assessment) and the Capability Maturity Model for Software , 1999 .

[5]  K. Bollen,et al.  Pearson's R and Coarsely Categorized Measures , 1981 .

[6]  M. C. Hill,et al.  Evaluating Model Fit , 2005 .

[7]  Austen Rainer,et al.  A quantitative and qualitative analysis of factors affecting software processes , 2003, J. Syst. Softw..

[8]  D. R. Johnson,et al.  Ordinal measures in multiple indicator models: A simulation study of categorization error. , 1983 .

[9]  Michael Daskalantonakis,et al.  A Practical View of Software Measurement and Implementation Experiences Within Motorola , 1992, IEEE Trans. Software Eng..

[10]  Rob Pooley,et al.  The Capability Maturity Model for Software , 2004 .

[11]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[12]  John W. Meyer,et al.  Institutionalized Organizations: Formal Structure as Myth and Ceremony , 1977, American Journal of Sociology.

[13]  Tracy Hall,et al.  Measurement in Software Process Improvement Programmes: An Empirical Study , 2000, IWSM.

[14]  R. Hoyle Structural equation modeling: concepts, issues, and applications , 1997 .

[15]  S. West,et al.  The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. , 1996 .

[16]  Watts S. Humphrey,et al.  A discipline for software engineering , 2012, Series in software engineering.

[17]  Norman E. Fenton,et al.  Implementing Effective Software Metrics Programs , 1997, IEEE Softw..

[18]  Carl Seddio Integrating test metrics within a software engineering measurement program at Eastman Kodak Company: A follow-up case study , 1993, J. Syst. Softw..

[19]  James D. Westphal,et al.  Customization or Conformity? An Institutional and Network Perspective on the Content and Consequences of TQM Adoption , 1997 .

[20]  Barbara A. Kitchenham,et al.  Modeling Software Measurement Data , 2001, IEEE Trans. Software Eng..

[21]  L. H. Rosenberg,et al.  Developing a Successful Metrics Programme , 1996 .

[22]  D. Ross Jeffery,et al.  An Instrument for Assessing Software Measurement Programs , 2000, Empirical Software Engineering.

[23]  M. S. Krishnan,et al.  An Empirical Analysis of Productivity and Quality in Software Products , 2000 .

[24]  KitchenhamBarbara,et al.  Towards a Framework for Software Measurement Validation , 1995 .

[25]  D. Ross Jeffery,et al.  A framework for evaluation and prediction of metrics program success , 1993, [1993] Proceedings First International Software Metrics Symposium.

[26]  Shari Lawrence Pfleeger,et al.  Lessons learned in building a corporate metrics program , 1993, IEEE Software.

[27]  Stewart Fenick,et al.  Implementing management metrics: an Army program , 1990, IEEE Software.

[28]  Robert E. Kraut,et al.  Coordination in Large Scale Software Development , 1990 .

[29]  Stephen G. West,et al.  Structural equation models with non-normal variables: Problems and remedies , 1995 .

[30]  Robert E. Kraut,et al.  Coordination in software development , 1995, CACM.

[31]  Mayuram S. Krishnan,et al.  The role of team factors in software cost and quality: An empirical analysis , 1998, Inf. Technol. People.

[32]  R. Zmud,et al.  Information technology implementation research: a technological diffusion approach , 1990 .

[33]  W. Powell,et al.  The iron cage revisited institutional isomorphism and collective rationality in organizational fields , 1983 .

[34]  R. Wolf A Framework for Evaluation. , 1987 .

[35]  Michael Berry,et al.  A targeted assessment of the software measurement process , 2001, Proceedings Seventh International Software Metrics Symposium.

[36]  Mark C. Paulk,et al.  Capability Maturity Model for Software , 2001 .

[37]  Fran O'Hara,et al.  European experiences with software process improvement , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[38]  Dianne M. Finkelstein,et al.  A Beginner's Guide to Structural Equation Modeling , 2005, Technometrics.

[39]  Ronald E. Nusenoff,et al.  A guidebook and a spreadsheet tool for a corporate metrics program , 1993, J. Syst. Softw..

[40]  Mark C. Paulk,et al.  Capability Maturity Model for Software, Version 1.1 , 1993 .

[41]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[42]  Robert W. Zmud,et al.  The Nature and Determinants of IT Acceptance, Routinization, and Infusion , 1993, Diffusion, Transfer and Implementation of Information Technology.

[43]  I. Rozman,et al.  United view on ISO 9001 model and SEI CMM , 1994, Proceedings of 1994 IEEE International Engineering Management Conference - IEMC '94.

[44]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[45]  Ray Offen,et al.  Establishing Software Measurement Programs , 1997, IEEE Softw..

[46]  Mark C. Paulk,et al.  Capability Maturity Model , 1991 .