A practitioner's guide to light weight software process assessment and improvement planning

Software process improvement (SPI) is challenging, particularly for small and medium sized enterprises. Most existing SPI frameworks are either too expensive to deploy, or do not take an organizations' specific needs into consideration. There is a need for light weight SPI frameworks that enable practitioners to base improvement efforts on the issues that are the most critical for the specific organization. This paper presents a step-by-step guide to process assessment and improvement planning using improvement framework utilizing light weight assessment and improvement planning (iFLAP), aimed at practitioners undertaking SPI initiatives. In addition to the guide itself the industrial application of iFLAP is shown through two industrial cases. iFLAP is a packaged improvement framework, containing both assessment and improvement planning capabilities, explicitly developed to be light weight in nature. Assessment is performed by eliciting improvements issues based on the organization's experience and knowledge. The findings are validated through triangulation utilizing multiple data sources. iFLAP actively involves practitioners in prioritizing improvement issues and identifying dependencies between them in order to package improvements, and thus establish a, for the organization, realistic improvement plan. The two cases of iFLAP application in industry are presented together with lessons learned in order to exemplify actual use of the framework as well as challenges encountered.

[1]  Assessment Method Integrated Team,et al.  Standard CMMI Appraisal Method for Process Improvement (SCAMPI), Version 1.1: Method Definition Document , 2001 .

[2]  Sam Kash Kachigan Statistical Analysis: An Interdisciplinary Introduction to Univariate & Multivariate Methods , 1986 .

[3]  Lionel C. Briand,et al.  AINSI: an inductive method for software process improvement: concrete steps and guidelines , 1995 .

[4]  W. A. Shewhart,et al.  Statistical method from the viewpoint of quality control , 1939 .

[5]  Magne Jørgensen,et al.  Can you Trust a Single Data Source Exploratory Software Engineering Case Study? , 2002, Empirical Software Engineering.

[6]  J. Herbsleb,et al.  A systematic survey of CMM experience and results , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[7]  Martin Höst,et al.  An Industrial Case Study on Distributed Prioritisation in Market-Driven Requirements Engineering for Packaged Software , 2001, Requirements Engineering.

[8]  Judith G. Brodman,et al.  Return on Investment (ROI) from Software Process Improvement as Measured by US Industry , 1995, Softw. Process. Improv. Pract..

[9]  Khaled El Emam,et al.  Fraunhofer Institute for Experimental Software Engineering , 1997, Softw. Process. Improv. Pract..

[10]  Claes Wohlin,et al.  Engineering and Managing Software Requirements , 2005 .

[11]  Mauri Laitinen,et al.  Process assessment considered wasteful , 1997, CACM.

[12]  Fergal McCaffery,et al.  Adept: A Unified Assessment Method for Small Software Companies , 2007, IEEE Software.

[13]  Tony Gorschek,et al.  Requirements Engineering Supporting Technical Product Management , 2006 .

[14]  Khaled El Emam,et al.  Elements of Software Process Assessment & Improvement , 1999 .

[15]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[16]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[17]  Donatella Sciuto,et al.  Pursuing coherence in software process assessment and improvement , 2001, Softw. Process. Improv. Pract..

[18]  Victor R. Basili,et al.  Software process evolution at the SEL , 1994, IEEE Software.

[19]  Terttu Orci,et al.  Dynamic CMM for Small Organisations , 2000 .

[20]  James D. Herbsleb,et al.  Software quality and the Capability Maturity Model , 1997, CACM.

[21]  Joachim Karlsson,et al.  A Cost-Value Approach for Prioritizing Requirements , 1997, IEEE Softw..

[22]  Victor R. Basili,et al.  Empirical Software Engineering Issues. Critical Assessment and Future Directions, International Workshop, Dagstuhl Castle, Germany, June 26-30, 2006. Revised Papers , 2007, Empirical Software Engineering Issues.

[23]  Donald J Reifer The CMMI: it's formidable , 2000, J. Syst. Softw..

[24]  James D. Herbsleb,et al.  Modelling the Likelihood of Software Process Improvement: An Exploratory Study , 2004, Empirical Software Engineering.

[25]  Karl E. Wiegers,et al.  A Modular Software Process Mini-Assessment Method - Tool Report , 2000, IEEE Softw..

[26]  Leonard Steinborn International Organization for Standardization ISO 9001:2000 Quality Management Systems — Requirements , 2004 .

[27]  Linda M. Northrop,et al.  CMMI Distilled : A Practical Introduction to Integrated Process Improvement , 2022 .

[28]  Manuel Pérez Cota,et al.  Experiences in the Application of Software Process Improvement in SMES , 2004, Software Quality Journal.

[29]  Tony Gorschek,et al.  Identification of Improvement Issues Using a Lightweight Triangulation Approach , 2003 .

[30]  Jean-Pierre Kuilboer,et al.  Software process and product improvement: an empirical assessment , 2000, Inf. Softw. Technol..

[31]  Victor R. Basili,et al.  Quantitative Evaluation of Software Methodology , 1985 .

[32]  Karen D. Prenger,et al.  Costs and Benefits of Software Process Improvement , 1997 .

[33]  Sami Zahran Software process improvement - practical guidelines for business success , 1998 .

[34]  Khaled El Emam,et al.  Spice: The Theory and Practice of Software Process Improvement and Capability Determination , 1997 .

[35]  John D'Ambra,et al.  Practical software process improvement - the IMPACT project , 2001, Proceedings 2001 Australian Software Engineering Conference.

[36]  David H. Kitson,et al.  An analysis of SEI software process assessment results: 1987-1991 , 1993, Proceedings of 1993 15th International Conference on Software Engineering.

[37]  Tony Gorschek,et al.  Packaging software process improvement issues: a method and a case study , 2004, Softw. Pract. Exp..

[38]  R. F.,et al.  Statistical Method from the Viewpoint of Quality Control , 1940, Nature.

[39]  Austen Rainer,et al.  A quantitative and qualitative analysis of factors affecting software processes , 2003, J. Syst. Softw..

[40]  Tony Gorschek,et al.  Requirements Abstraction Model , 2005, Requirements Engineering.

[41]  Stephan Jacobs Introducing measurable quality requirements: a case study , 1999, Proceedings IEEE International Symposium on Requirements Engineering (Cat. No.PR00188).

[42]  Marvin V. Zelkowitz,et al.  Lessons learned from 25 years of process improvement: the rise and fall of the NASA software engineering laboratory , 2002, Proceedings of the 24th International Conference on Software Engineering. ICSE 2002.

[43]  Victor R. Basili,et al.  The Experimental Paradigm in Software Engineering , 1992, Experimental Software Engineering Issues.

[44]  S. B. Kiselev,et al.  The capability maturity model: guidelines for improving the software process , 1995 .

[45]  Kurt Schneider Active Probes Synergy in Experience-Based Process Improvement , 2000, PROFES.

[46]  David Zubrow,et al.  Moving On Up: Data and Experience Doing CMM-Based Process Improvement , 1995 .

[47]  Austen Rainer,et al.  Software Process Improvement Problems in Twelve Software Companies: An Empirical Analysis , 2003, Empirical Software Engineering.

[48]  Reidar Conradi,et al.  Improving Software Process Improvement , 2002, IEEE Softw..

[49]  Colin Robson,et al.  Real World Research: A Resource for Social Scientists and Practitioner-Researchers , 1993 .

[50]  Daniela E. Damian,et al.  An industrial case study of the impact of requirements engineering on downstream development , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[51]  Khaled El Emam,et al.  Costs and Benefits of Software Process Improvement , 1997 .

[52]  Didar Zowghi,et al.  A Maturity Model for the Implementation of Software Process Improvement: an Empirical Study , 2022 .

[53]  Margo McCall,et al.  IEEE Computer Society , 2019, Encyclopedia of Software Engineering.

[54]  Cmmi Product Team CMMI for Development, Version 1.2 , 2010 .