The Business Case for Systems Engineering Study: Results of the Systems Engineering Effectiveness Survey

Abstract : This report summarizes the results of a survey that had the goal of quantifying the connection between the application of systems engineering (SE) best practices to projects and programs and the performance of those projects and programs. The survey population consisted of projects and programs executed by system developers reached through the National Defense Industrial Association Systems Engineering Division (NDIA-SED), the Institute of Electrical and Electronics Engineers Aerospace and Electronic Systems Society (IEEE-AESS), and the International Council on Systems Engineering (INCOSE). Analysis of survey responses revealed strong statistical relationships between project performance and several categories of specific SE best practices. The survey results show notable differences in the relationship between SE best practices and performance between more challenging and less challenging projects. The statistical relationship with project performance is quite strong for survey data of this kind when both SE capability and project challenge are considered together.

[1]  Khaled El Emam,et al.  A Survey of Systems Engineering Effectiveness , 2007 .

[2]  James McCurley,et al.  Performance Effects of Measurement and Analysis: Perspectives from CMMI High Maturity Organizations and Appraisers , 2010 .

[3]  J.P. Elm,et al.  A Study of Systems Engineering Effectiveness - Initial Results , 2008, 2008 2nd Annual IEEE Systems Conference.

[4]  Eric C. Honour,et al.  Understanding the Value of Systems Engineering , 2004 .

[5]  J. Guilford.  Psychometric methods, 2nd ed. , 1954 .

[6]  Pawel Lewicki,et al.  Statistics : methods and applications : a comprehensive reference for science, industry, and data mining , 2006 .

[7]  James McCurley,et al.  Use and Organizational Effects of Measurement and Analysis in High Maturity Organizations: Results from the 2008 SEI State of Measurement and Analysis Practice Surveys , 2009 .

[8]  Robert W. Stoddard,et al.  Approaches to Process Performance Modeling: A Summary from the SEI Series of Workshops on CMMI High Maturity Measurement and Analysis , 2010 .

[9]  Linton C. Freeman,et al.  Elementary applied statistics : for students in behavioral science , 1967 .

[10]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[11]  Jacqueline Grennon.  , 2nd Ed. , 2002, The Journal of nervous and mental disease.

[12]  Joseph P Elm.  The Business Case for Systems Engineering Study: Assessing Project Performance from Sparse Data , 2012 .

[13]  Joseph P Elm,et al.  The Business Case for Systems Engineering Study: Detailed Response Data , 2012 .

[14]  James S. Coleman,et al.  Models of change and response uncertainty , 1964 .