Empirical evaluation of selected best practices in implementation of software process improvement

To be successfully applied in practice, software process improvement (SPI) needs not only identifying what needs to be improved, and which factors will influence its success, but also guidelines on how to implement those improvements and meet the factors. This paper proposes an SPI implementation strategy that has been developed in lines with standard SPI models and frameworks, intended to be suitable for global software development (GSD), and exploiting ideas of incremental deliveries, short iterations with frequent reviews and close collaboration with customers. Quantitative analyses of data from case studies within large GSD show that improvement teams implementing the strategy are more likely to have better progress and achieve better effectiveness in terms of improvement deployment within development teams. The results could be useful to SPI practitioners in making their SPI initiatives more successful.

[1]  Dennis R. Goldenson,et al.  A systematic survey of CMM experience and results , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[2]  John E. West,et al.  Amendment to ISO 9001:2000 - Quality Management Systems - Requirements and Revision of ISO 9004:2000 - Quality Management Systems - Guidelines for Performance Improvement , 2007 .

[3]  Ita Richardson SPI Models: What Characteristics Are Required for Small Software Development Companies? , 2002, ECSQ.

[4]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[5]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[6]  Victor R. Basili,et al.  Improve Software Quality by Reusing Knowledge and Experience , 1995 .

[7]  Leonard Steinborn International Organization for Standardization ISO 9001:2000 Quality Management Systems — Requirements , 2004 .

[8]  Heather Fry,et al.  A user’s guide , 2003 .

[9]  Philip B. Crosby,et al.  Quality Is Still Free: Making Quality Certain in Uncertain Times , 1995 .

[10]  T. Kahkonen,et al.  Agile methods for large organizations - building communities of practice , 2004, Agile Development Conference.

[11]  Victor R. Basili,et al.  Iterative and incremental developments. a brief history , 2003, Computer.

[12]  D. Ross Jeffery,et al.  An exploratory study of why organizations do not adopt CMMI , 2007, J. Syst. Softw..

[13]  Jarmo J. Ahonen,et al.  Big Improvements with Small Changes: Improving the Processes of a Small Software Company , 2008, PROFES.

[14]  Austen Rainer,et al.  Key success factors for implementing software process improvement: a maturity-based analysis , 2002, J. Syst. Softw..

[15]  R. Kaplan,et al.  The Balanced Scorecard: Translating Strategy into Action , 1996 .

[16]  Didar Zowghi,et al.  A framework for assisting the design of effective software process improvement implementation strategies , 2005, J. Syst. Softw..

[17]  Rini van Solingen,et al.  Measuring the ROI of Software Process Improvement , 2004, IEEE Softw..

[18]  R. Yin Case Study Research: Design and Methods , 1984 .

[19]  Tracy Hall,et al.  De-motivators for software process improvement: an analysis of practitioners' views , 2003, J. Syst. Softw..

[20]  Ken Schwaber,et al.  Agile Software Development with SCRUM , 2001 .

[21]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[22]  Didar Zowghi,et al.  A Maturity Model for the Implementation of Software Process Improvement: an Empirical Study , 2022 .

[23]  Lars Mathiassen,et al.  Managing change in software process improvement , 2005, IEEE Software.

[24]  E. Ziegel Juran's Quality Control Handbook , 1988 .

[25]  James D. Herbsleb,et al.  Modelling the Likelihood of Software Process Improvement: An Exploratory Study , 2004, Empirical Software Engineering.

[26]  Muhammad Ali Babar,et al.  Identifying high perceived value practices of CMMI level 2: An empirical study , 2009, Inf. Softw. Technol..

[27]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[28]  James D. Herbsleb,et al.  Architectures, coordination, and distance: Conway’s law and beyond , 1999 .

[29]  David N. Wilson,et al.  A framework for evaluation and prediction of software process improvement success , 2001, J. Syst. Softw..

[30]  Khaled El Emam,et al.  Spice: The Theory and Practice of Software Process Improvement and Capability Determination , 1997 .

[31]  Austen Rainer,et al.  Software Process Improvement Problems in Twelve Software Companies: An Empirical Analysis , 2003, Empirical Software Engineering.

[32]  John May,et al.  Tailoring XP for Large System Mission Critical Software Development , 2002, XP/Agile Universe.

[33]  James D. Herbsleb,et al.  Global Software Engineering: The Future of Socio-technical Coordination , 2007, Future of Software Engineering (FOSE '07).

[34]  Tore Dybå,et al.  An empirical investigation of the key factors for success in software process improvement , 2005, IEEE Transactions on Software Engineering.

[35]  R. Zmud An Examination of Push-Pull Theory Applied to Process Innovation in Knowledge Work , 1984 .

[36]  Tihana Galinac Grbac,et al.  Software Verification Process Improvement Proposal Using Six Sigma , 2007, PROFES.

[37]  Alistair Cockburn,et al.  Agile Software Development , 2001 .

[38]  Tony Gorschek,et al.  Packaging software process improvement issues: a method and a case study , 2004, Softw. Pract. Exp..

[39]  Austen Rainer,et al.  A quantitative and qualitative analysis of factors affecting software processes , 2003, J. Syst. Softw..

[40]  Richard Messnarz,et al.  Better Software Practice for Business Benefit: Principles and Experiences , 1999 .

[41]  James D. Herbsleb,et al.  After the Appraisal: A Systematic Survey of Process Improvement, its Benefits, and Factors that Influence Success. , 1995 .

[42]  Tore Dybå,et al.  An Instrument for Measuring the Key Factors of Success in Software Process Improvement , 2000, Empirical Software Engineering.

[43]  Deborah Hartmann,et al.  Appropriate agile measurement: using metrics and diagnostics to deliver business value , 2006, AGILE 2006 (AGILE'06).