Statistically Based Process Monitoring: Lessons from the Trench

Monitoring software processes is a non trivial task. Recently many authors have suggested the use of Statistical Process Control (SPC) for monitoring software processes, while others have pointed out its potential pitfalls. Indeed, the main problem is that SPC is often used "as is" without the appropriate customizations or extensions needed for making it applicable to software contexts. This work points out and discusses four main issues related to software process monitoring and highlights how SPC can be used as solution to address each problem. The solutions arise from experience collected by the authors during empirical investigations in industrial contexts. As so, this work is intended as a first step in clarifying how SPC can contribute to practically solve some monitoring issues and guide practitioners towards a more disciplined and correct use of the approach in controlling software processes.

[1]  Danilo Caivano,et al.  Continuous software process improvement through statistical process control , 2005, Ninth European Conference on Software Maintenance and Reengineering.

[2]  S. K. Pillai,et al.  Statistical Process Control to Improve Coding and Code Review , 2003, IEEE Softw..

[3]  William A. Florac,et al.  Practical Software Measurement: Measuring for Process Management and Improvement, , 1997 .

[4]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .

[5]  Maria Teresa Baldassarre,et al.  Managing Software Process Improvement (SPI) through Statistical Process Control (SPC) , 2004, PROFES.

[6]  Nicola Boffoli,et al.  Non-intrusive monitoring of software quality , 2006, Conference on Software Maintenance and Reengineering (CSMR'06).

[7]  Pankaj Jalote,et al.  CMM in Practice: Processes for Executing Software Projects at Infosys , 1999 .

[8]  Maria Teresa Baldassarre,et al.  Systematic Review of Statistical Process Control: An Experience Report , 2007, EASE.

[9]  Ed Weller Applying Quantitative Methods to Software Maintenance , 2000 .

[10]  William A. Florac,et al.  Measuring the Software Process: Statistical Process Control for Software Process Improvement , 1999 .

[11]  Maria Teresa Baldassarre,et al.  Improving dynamic calibration through statistical process control , 2005, 21st IEEE International Conference on Software Maintenance (ICSM'05).

[12]  Maria Teresa Baldassarre,et al.  SPEED: Software Project Effort Evaluator based on Dynamic-calibration , 2006, 2006 22nd IEEE International Conference on Software Maintenance.

[13]  Lloyd S. Nelson,et al.  Interpreting Shewhart X̄ Control Charts , 1985 .

[14]  Ho-Jin Choi,et al.  A Framework for the Use of Six Sigma Tools in PSP/TSP , 2007, 5th ACIS International Conference on Software Engineering Research, Management & Applications (SERA 2007).

[15]  Eugene L. Grant,et al.  Statistical Quality Control , 1946 .

[16]  N. Eickelmann,et al.  Statistical Process Control: What You Don't Measure Can Hurt You! , 2003, IEEE Softw..

[17]  Ellis Horowitz,et al.  Software Cost Estimation with COCOMO II , 2000 .

[18]  Pankaj Jalote,et al.  Optimum Control Limits for Employing Statistical Process Control in Software Process , 2002, IEEE Trans. Software Eng..

[19]  Edward F. Weller Practical Applications of Statistical Process Control , 2000, IEEE Softw..

[20]  W. Shewhart The Economic Control of Quality of Manufactured Product. , 1932 .

[21]  Mark C. Paulk APPLYING SPC TO THE PERSONAL SOFTWARE PROCESS , 2000 .

[22]  W. A. Shewhart,et al.  Statistical method from the viewpoint of quality control , 1939 .

[23]  Donald J. Wheeler,et al.  Understanding Statistical Process Control , 1986 .

[24]  Danilo Caivano,et al.  Software renewal process comprehension using dynamic effort estimation , 2001, Proceedings IEEE International Conference on Software Maintenance. ICSM 2001.

[25]  Eugene L. Grant Statistical quality control / Eugene L. Grant, Richard S. Leavenworth , 1980 .

[26]  Onur Demirörs,et al.  Utilization of statistical process control (SPC) in emergent software organizations: Pitfalls and suggestions , 2006, Software Quality Journal.

[27]  Lloyd S. Nelson,et al.  Column: Technical Aids: The Shewhart Control Chart--Tests for Special Causes , 1984 .

[28]  David N. Card Statistical process control for software? , 1994, IEEE Software.

[29]  I. Rus,et al.  Guest Editors' Introduction: Process Diversity in Software Development , 2000, IEEE Softw..

[30]  William A. Florac,et al.  Statistical Process Control: Analyzing a Space Shuttle Onboard Software Process , 2000, IEEE Softw..

[31]  H. Dehesh,et al.  Practical applications of TCM , 1990, IEEE Conference on Military Communications.

[32]  Maria Teresa Baldassarre,et al.  Software renewal projects estimation using dynamic calibration , 2003, International Conference on Software Maintenance, 2003. ICSM 2003. Proceedings..

[33]  Ioana Rus,et al.  Process diversity , 2003, J. Softw. Maintenance Res. Pract..

[34]  Stuart Anderson,et al.  Requirements Evolution from Process to Product Oriented Management , 2001, PROFES.