The impact of software process improvement on quality: in theory and practice

To remain competitive, software companies must establish practices that enhance quality and advance process management. To this end, they have increasingly turned to software process improvement (SPI) methodologies, of which the ISO 9000 standards and the capability maturity model (CMM) are the best known. The underlying principle of both methodologies is to assess organizational capabilities to produce quality software, but they depend on different underlying processes.Whether the practices advocated by these methodologies lead to high-quality software has been the topic of ongoing debates. Both scholars and practitioners are looking for hard evidence to justify the time and effort required by such guidelines to improve the software-development process and its end product.In this paper, we investigate the impact of SPI methodologies on software quality, first by theoretical comparison and then with empirical data. Our findings reveal that each methodology has had a different level of impact on software quality factors. These findings could help software-development organizations select the methodology or combination that best meets their quality requirement.

[1]  Jeffrey A. Ingalsbe,et al.  A METAMODEL FOR THE CAPABILITY MATURITY MODEL FOR SOFTWARE , 2001 .

[2]  Roger S. Pressman,et al.  Software Engineering: A Beginner's Guide , 1988 .

[3]  D. H. Kitson,et al.  Relating the SPICE framework and SEI approach to software process assessment , 1996, Software Quality Journal.

[4]  F. M. Gryna Quality planning and analysis , 1970 .

[5]  Iain D. Craig,et al.  Principles of Software Engineering Management by Tom Gilb with Susannah Pinzi, Addison-Wesley, Wokingham, UK, 442 pages (incl. index) (£17.95) , 1989, Robotica (Cambridge. Print).

[6]  Robert Bamford,et al.  Hybrid Multi-Model Assessment When the CMM Meets ISO 9001 , 1998 .

[7]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[8]  Mark C. Paulk,et al.  How ISO 9001 Compares With The CMM , 1995, IEEE Softw..

[9]  R. C. Bamford,et al.  Standards-comparing, contrasting ISO 9001 and the SEI capability maturity model , 1993 .

[10]  James D. Herbsleb,et al.  Software quality and the Capability Maturity Model , 1997, CACM.

[11]  Mayuram S. Krishnan,et al.  Measuring Process Consistency: Implications for Reducing Software Defects , 1999, IEEE Trans. Software Eng..

[12]  Alka Jarvis,et al.  ISO 9000-3 , 1995 .

[13]  Leon J. Osterweil,et al.  Strategic directions in software quality , 1996, CSUR.

[14]  Alka Jarvis,et al.  ISO 9000-3 - a tool for software product and process improvement , 1995 .

[15]  J. G. Verrijdt,et al.  ISO 9000 versus CMM: Standardization and certification of IS development , 1997, Inf. Manag..

[16]  Shari Lawrence Pfleeger,et al.  Software Quality: The Elusive Target , 1996, IEEE Softw..

[17]  Douglas R. Vogel,et al.  Managing software quality in a very large development project , 1995, Inf. Manag..

[18]  Ross T. Hightower,et al.  Total Quality Management. Are information systems managers ready? , 1995, Inf. Manag..

[19]  BowmanDick Principles of software engineering management , 1989 .

[20]  Khaled El Emam,et al.  Does Organizational Maturity Improve Quality? , 1996, IEEE Softw..

[21]  Mayuram S. Krishnan,et al.  Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development , 2000 .

[22]  William E. Perry Quality Assurance for Information Systems: Methods, Tools, and Techniques , 1991 .

[23]  Roger S. Pressman Software Process Impediment , 1996, IEEE Softw..

[24]  J. Bert Keats,et al.  Quality Planning and Analysis , 1981 .

[25]  S. L. Pfleeger Workshop Defines Problems with Software-Engineering Data , 1996 .

[26]  Susan R. Bailey,et al.  Process control (ISO 9000) and process improvement (APEX) in the transmission systems business unit , 1994, AT&T Technical Journal.

[27]  Khaled El Emam,et al.  Validating the ISO/IEC 15504 Measure of Software Requirements Analysis Process Capability , 2000, IEEE Trans. Software Eng..

[28]  Michael W. Evans,et al.  Software quality assurance and management , 1987 .

[29]  Suzanne Garcia,et al.  Key Practices of the Capability Maturity Model, Version 1.1 , 1993 .

[30]  W. Deming Quality, productivity, and competitive position , 1982 .

[31]  Tom Gilb,et al.  Principles of software engineering management , 1988 .

[32]  S. Sheard Evolution of the Frameworks Quagmire , 2001 .

[33]  Roger S. Pressman Software Process Perceptions , 1996, IEEE Softw..

[34]  Capers Jones,et al.  The Economics of Software Process Improvement , 1996, Computer.

[35]  M. S. Krishnan,et al.  An Empirical Analysis of Productivity and Quality in Software Products , 2000 .

[36]  Bijan Fazlollahi,et al.  Selecting a requirement determination methodology-contingency approach revisited , 1991, Inf. Manag..