Use and Organizational Effects of Measurement and Analysis in High Maturity Organizations: Results from the 2008 SEI State of Measurement and Analysis Practice Surveys

Abstract : There has been a great deal of discussion of late about what it takes for organizations to attain high maturity status and what they can reasonably expect to gain by doing so. Clarification is needed along with good examples of what has worked well and what has not. This may be particularly so with respect to measurement and analysis. This report contains results from a survey of high maturity organizations conducted by the Software Engineering Institute (SEI) in 2008. The questions center on the use of process performance modeling in those organizations and the value added by that use. The results show considerable understanding and use of process performance models among the organizations surveyed; however there is also wide variation in the respondents? answers. The same is true for the survey respondents? judgments about how useful process performance models have been for their organizations. As is true for less mature organizations, there is room for continuous improvement among high maturity organizations. Nevertheless, the respondents? judgments about the value added by doing process performance modeling also vary predictably as a function of the understanding and use of the models in their respective organizations. More widespread adoption and improved understanding of what constitutes a suitable process performance model holds promise to improve CMMI-based performance outcomes considerably.

[1]  Terence Patrick Rout,et al.  Measurement and Analysis in Capability Maturity Model Integration Models and Software Process Improvement , 2003 .

[2]  Pawel Lewicki,et al.  Statistics : methods and applications : a comprehensive reference for science, industry, and data mining , 2006 .

[3]  Dennis R. Goldenson,et al.  CMMI High Maturity Measurement and Analysis Workshop Report: March 2008 , 2008 .

[4]  Mark Kasunic The State of Software Measurement Practice: Results of 2006 Survey , 2006 .

[5]  Lorene M Nelson,et al.  Measurement and Analysis , 2004 .

[6]  M. Pursley Report Documentation Page Form Approved Omb No. 0704-0188 Please Do Not Return Your Form to the above Address. 1. Report Date (dd-mm-yyyy) Final Technical Report Receiver Statistics for Cognitive Radios in Dynamic Spectrum Access Networks Onr , 2007 .

[7]  Mark Kasunic,et al.  Can You Trust Your Data? Establishing the Need for a Measurement and Analysis Infrastructure Diagnostic , 2008 .

[8]  Diane L. Gibson,et al.  Demonstrating the Impact and Benefits of CMMI ® : An Update and Preliminary Results , 2003 .

[9]  James S. Coleman,et al.  Models of change and response uncertainty , 1964 .

[10]  Khaled El Emam,et al.  A Survey of Systems Engineering Effectiveness - Initial Results (with detailed survey response data) , 2008 .

[11]  Tridas Mukhopadhyay,et al.  Determinants of success in software measurement programs: initial results , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[12]  Egon Berghout,et al.  The Goal/Question/Metric method: a practical guide for quality improvement of software development , 1999 .

[13]  D. Wooff Logistic Regression: a Self-learning Text, 2nd edn , 2004 .

[14]  Mike Konrad,et al.  Tutorial: If You're Living the High Life, You're Living the Informative Material , 2007 .

[15]  Matthias Schroder,et al.  Logistic Regression: A Self-Learning Text , 2003 .

[16]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[17]  Linton G. Freeman,et al.  Elementary Applied Statistics for students in Behavioral Science , 1965 .

[18]  William A. Florac,et al.  Goal-Driven Software Measurement. A Guidebook. , 1996 .

[19]  Mark C. Paulk,et al.  Capability Maturity Model for Software , 2001 .

[20]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[21]  Mayuram S. Krishnan,et al.  Measurement Programs in Software Development: Determinants of Success , 2002, IEEE Trans. Software Eng..

[22]  Diane L. Gibson,et al.  Performance Results of CMMI ® -Based Process Improvement , 2006 .