Critical success factors for software process improvement implementation: an empirical study

In this article, we present findings from our recent empirical study of the critical success factors (CSFs) for software process improvement (SPI) implementation with 34 SPI practitioners. The objective of this study is to provide SPI practitioners with sufficient knowledge about the nature of issues that play a positive role in the implementation of SPI programmes in order to assist them in effectively planning SPI implementation strategies. Through our empirical study we identified seven factors (higher management support, training, awareness, allocation of resources, staff involvement, experienced staff and defined SPI implementation methodology) that are generally considered critical for successfully implementing SPI. We also report on a literature survey of CSFs that impact SPI and identify six factors (senior management commitment, staff involvement, staff time and resources, training and mentoring, creating process action teams and reviews). We compared our empirical study results with the literature and confirmed the factors identified in the literature, and also identified two new CSFs (SPI awareness and defined SPI implementation methodology) that were not identified in the literature. Finally, we analyzed the CSFs identified by different groups of practitioners and found that they are aware of what is imperative for the successful implementation of SPI programmes. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  Raymond Dion,et al.  Process improvement and the corporate balance sheet , 1993, IEEE Software.

[2]  Austen Rainer,et al.  A quantitative and qualitative analysis of factors affecting software processes , 2003, J. Syst. Softw..

[3]  Albert Johnson Software process improvement experience in the DP/MIS function: experience report , 1994, ICSE 1994.

[4]  Susan Rosenbaum,et al.  Software improvements in an international company , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[5]  James D. Herbsleb,et al.  After the Appraisal: A Systematic Survey of Process Improvement, its Benefits, and Factors that Influence Success. , 1995 .

[6]  Susan Rosenbaum,et al.  Schlumberger's Software Improvement Program , 1994, IEEE Trans. Software Eng..

[7]  Brian Fitzgerald,et al.  A Longitudinal Study of Software Process Improvement , 1999, IEEE Softw..

[8]  J. Herbsleb,et al.  A systematic survey of CMM experience and results , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[9]  H. J. Arnold Introduction to the Practice of Statistics , 1990 .

[10]  Bill Pitterman Telcordia Technologies: The Journey to High Maturity , 2000, IEEE Softw..

[11]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[12]  Bill Curtis,et al.  The global pursuit of process maturity , 2000 .

[13]  P. Burnard A method of analysing interview transcripts in qualitative research. , 1991, Nurse education today.

[14]  Austen Rainer,et al.  Implementing software process improvement: an empirical study , 2002, Softw. Process. Improv. Pract..

[15]  Stan Rifkin Why Software Process Innovations Are Not Adopted , 2001, IEEE Softw..

[16]  R. R. Willis,et al.  Hughes Aircraft's Widespread Deployment of a Continuously Improving Software Process , 1998 .

[17]  Werner Mellis,et al.  Success factors of organizational change in software process improvement , 1998 .

[18]  Peter Axel Nielsen,et al.  Implementing software process improvement: two cases of technology transfer , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[19]  Austen Rainer,et al.  Requirements problems in twelve software companies: an empirical analysis , 2002, IEE Proc. Softw..

[20]  Hugh Coolican Research Methods and Statistics in Psychology , 1993 .

[21]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[22]  Adam A. Porter,et al.  Empirical studies of software engineering: a roadmap , 2000, ICSE '00.

[23]  J.S. Reel,et al.  Critical Success Factors in Software Projects , 1999, IEEE Softw..

[24]  J. Rockart Chief executives define their own data needs. , 1979, Harvard business review.

[25]  Judy E. Scott The FoxMeyer Drugs' Bankruptcy: Was it a Failure of ERP? , 1999 .

[26]  John W. Creswell,et al.  Research Design: Qualitative and Quantitative Approaches , 1997 .

[27]  Didar Zowghi,et al.  A framework for assisting the design of effective software process improvement implementation strategies , 2005, J. Syst. Softw..

[28]  Didar Zowghi,et al.  A Model for the Implementation of Software Process Improvement: An Empirical Study , 2003, PROFES.

[29]  Nathan Baddoo,et al.  Implementing a people focused SPI programme , 2001 .

[30]  Nathan Baddoo,et al.  Motivators and de-motivators in software process improvement : an empirical study , 2001 .

[31]  C. Billings,et al.  Journey to a Mature Software Process , 1994, IBM Syst. J..

[32]  David W. Bustard,et al.  Software process improvement: making it happen in practice , 1997, Software Quality Journal.

[33]  Michael Diaz,et al.  How Software Process Improvement Helped Motorola , 1997, IEEE Softw..

[34]  Tore Dybå,et al.  An Instrument for Measuring the Key Factors of Success in Software Process Improvement , 2000, Empirical Software Engineering.

[35]  Didar Zowghi,et al.  A Maturity Model for the Implementation of Software Process Improvement: an Empirical Study , 2022 .

[36]  Stefan Biffl,et al.  Directions and Methodologies for Empirical Software Engineering Research , 2004, Empirical Software Engineering.

[37]  R. Dion,et al.  Elements of a process-improvement program (software quality) , 1992, IEEE Software.

[38]  Tracy Hall,et al.  De-motivators for software process improvement: an analysis of practitioners' views , 2003, J. Syst. Softw..

[39]  Andy J. Nolan,et al.  Learning from Success , 1999, IEEE Softw..

[40]  Austen Rainer,et al.  Key success factors for implementing software process improvement: a maturity-based analysis , 2002, J. Syst. Softw..

[41]  T. D. Wilson,et al.  The management information requirements of heads of university departments: a critical success factors approach , 1993, J. Inf. Sci..

[42]  James D. Herbsleb,et al.  Benefits of CMM-Based Software Process Improvement: Initial Results , 1994 .

[43]  Toni M. Somers,et al.  The impact of critical success factors across the stages of enterprise resource planning implementations , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[44]  Atte Kinnula,et al.  Deploying the defined SW process , 2000 .

[45]  M. Paulk Using the Software CMM in Small Organizations , 1998 .

[46]  D. Wilson,et al.  Views of software quality: a field report , 1997, IEE Proc. Softw. Eng..

[47]  Deependra Moitra,et al.  Managing change for software process improvement initiatives: a practical experience‐based approach , 1998 .

[48]  Thomas Black Doing Quantitative Research in the Social Sciences: An Integrated Approach to Research Design, Measurement and Statistics , 1999 .

[49]  M. Skaloud General report Systems—frames, shells and plated structures , 1994 .

[50]  Watts S. Humphrey,et al.  Software process improvement at Hughes Aircraft , 1991, IEEE Software.

[51]  Mark C. Paulk,et al.  Practices of High Maturity Organizations , 1999 .

[52]  Girish Seshagiri,et al.  Software Process Improvement Works , 1999 .

[53]  Claude Y. Laporte,et al.  Addressing the people issues of process improvement activities at Oerlikon Aerospace , 1998 .

[54]  Marvin V. Zelkowitz,et al.  Lessons learned from 25 years of process improvement: the rise and fall of the NASA software engineering laboratory , 2002, Proceedings of the 24th International Conference on Software Engineering. ICSE 2002.

[55]  Didar Zowghi,et al.  Critical Success Factors and Critical Barriers for Software Process Improvement: An Analysis of Literature , 2003 .

[56]  T. D. Wilson,et al.  Determining organizational information needs: the Critical Success Factors approach , 2001, Inf. Res..

[57]  George Yamamura Process Improvement Satisfies Employees , 1999, IEEE Softw..

[58]  Paul D Jeanne Ellis Ormrod Leedy,et al.  Practical Research: Planning and Design , 1974 .

[59]  Priscilla Fowler,et al.  Lessons Learned Collaborating on a Process for SPI at Xerox , 1999 .

[60]  Tracy Hall,et al.  Perceptions of software quality: a pilot study , 1998, Software Quality Journal.