What Can Be Learned from CMMi Failures?

The software crisis has been around since 1968 when NATO first identified the problematic nature of software development. In recognition of the need to manage the process of software development many methodologies have been proposed over the years. A recent contribution to this rich set of rigorous software development methodologies is the Software Engineering Institute’s (SEI) Capability Maturity Model Integration (CMMi) methodology. While the minimal previous research on CMMi has extolled it, learning how to implement CMMi successfully requires leaning also from its failures. And yet, despite apparent anecdotes, little is known on this topic possibly because of the reluctance of many companies to wash their dirty linen in public. Based on a set of in-depth interviews accompanied with survey verification, this study examines the assessed effectiveness and efficiency of CMMi as implemented in several projects in a large high tech company in which only low levels of CMMi maturity were reached. In an exploratory manner this study shows the need to differentiate between the quality of the software product developed through CMMi and the quality of the process involved. The study also shows that whether the product is an off the shelf product or a customized one has a direct bearing of the quality of the product developed under CMMi methodology and the process itself. In particular, we discuss why some projects reach only a low maturity level of CMMi even though the organization as a whole might typically reach high maturity levels.

[1]  Scott A. Hissam Case Study: Correcting System Failure in a COTS Information System , 1998 .

[2]  Mark C. Paulk,et al.  Capability Maturity Model for Software, Version 1.1 , 1993 .

[3]  Capers Jones,et al.  Programming Productivity , 1986 .

[4]  R. Baskerville,et al.  Strategy models for enabling offshore outsourcing: Russian short-cycle-time software development , 2005 .

[5]  Delores Etter,et al.  Capability Maturity Model® Integration (CMMISM): A view from the sponsors , 2002 .

[6]  Mayuram S. Krishnan,et al.  Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development , 2000 .

[7]  Frederick P. Brooks,et al.  No Silver Bullet: Essence and Accidents of Software Engineering , 1987 .

[8]  Gary Klein,et al.  An exploration of the relationship between software development process maturity and project performance , 2004, Inf. Manag..

[9]  Moshe Zviran,et al.  Relationships between Organizational and Information Systems Objectives: Some Empirical Evidence , 1990, J. Manag. Inf. Syst..

[10]  Detmar W. Straub,et al.  A Practical Guide To Factorial Validity Using PLS-Graph: Tutorial And Annotated Example , 2005, Commun. Assoc. Inf. Syst..

[11]  James D. Herbsleb,et al.  Software quality and the Capability Maturity Model , 1997, CACM.

[12]  Diane L. Gibson,et al.  Demonstrating the Impact and Benefits of CMMI ® : An Update and Preliminary Results , 2003 .

[13]  Frank E. McGarry,et al.  Enabling Process Discipline: Lessons from the Journey to CMM Level 5 , 2005, MIS Q. Executive.

[14]  James E. Tomayko,et al.  The SEI curriculum modules and their influence: Norm Gibbs' legacy to software engineering education , 2005, J. Syst. Softw..

[15]  Didar Zowghi,et al.  A Maturity Model for the Implementation of Software Process Improvement: an Empirical Study , 2022 .

[16]  Michael W. Evans SPMN Director Identifies 16 Critical Software Practices , .

[17]  R. Hefner,et al.  Things they never taught you in CMM school , 2001, Proceedings 26th Annual NASA Goddard Software Engineering Workshop.

[18]  Mark C. Paulk,et al.  Capability Maturity Model for Software , 2001 .

[19]  Bill Pitterman Telcordia Technologies: The Journey to High Maturity , 2000, IEEE Softw..

[20]  Mayuram S. Krishnan,et al.  The role of software processes and communication in offshore software development , 2002, CACM.

[21]  Sendil K. Ethiraj,et al.  Where Do Capabilities Come from and How Do They Matter? A Study in the Software Services Industry , 2005 .

[22]  Wynne W. Chin The partial least squares approach for structural equation modeling. , 1998 .

[23]  Robert Dunn,et al.  Software Defect Removal , 1984 .

[24]  Yan Xu AGILE METHODOLOGY IN CMM FRAMEWORK : AN APPROACH TO SUCCESS FOR SOFTWARE COMPANIES IN CHINA , .