An Instrument to Assess Individual Capacity for System Thinking

AN INSTRUMENT TO ASSESS INDIVIDUAL CAPACITY FOR SYSTEMS THINKING Ra’ed M. Jaradat Old Dominion University, 2014 Director: Prof. Charles B. Keating The purpose of this research was to develop and deploy a new systems thinking instrument to assess individual capacity for systems thinking using an inductive research design. While technology has been increasing exponentially, the corresponding methods to harness those technological advances, and the problems they have spawned, is lagging. While there is a broad collection of systems based methods, techniques, technologies, and tools that can be used in dealing with complex problems, these are predicated on an individual's capacity for engaging a level of systems thinking commensurate with their effective deployment. Research based methods to determine individual capacity for systems thinking were not found in the literature. This research addressed the literature gap by developing an instrument to determine the individual capacity for systems thinking. To establish the characteristics for systems thinking, over 1000 systems based articles were analyzed and coded. Following grounded theory, as articulated by Strauss and Corbin (1990), a rigorous methodology was executed to inductively build the framework for systems thinking characteristics. Specialized software to support grounded theory, Nvivo (QRS International, version 10, 2014) was used to navigate and manage the large amount of qualitative and quantitative data for the research. A mixed method approach was used to collect and analyze qualitative and quantitative data in the initial instrument development. After deriving the set o f systems thinking characteristics, a non-domain specific systems thinking (Sc) instrument was constructed to capture and measure the state o f systems thinking at the individual level. The instrument consists of 39 binary questions with fourteen scored scales to measure seven main systems skills preferences. Following a pilot study for application of the instrument, it was administered to 242 participants. To establish validity, multiple validity checks including face validity, internal validity, conclusion validity and content validity were performed. Reliability testing was also conducted, including Cronbach’s Alpha Test and Parallel Test, with excellent results. The results o f the research show significant promise for the instrument to capture the capacity of individuals to engage in systems thinking. The document concludes with directions for future research and implications for practitioners related to the capacity of individuals for systems thinking.

[1]  Harold A. Linstone,et al.  The Unbounded Mind: Breaking the Chains of Traditional Business Thinking , 1993 .

[2]  George P. Richardson,et al.  Feedback Thought in Social Science and Systems Theory , 1991 .

[3]  Elmer Culler,et al.  Die physischen gestalten in ruhe und im station?ren zustand. , 1926 .

[4]  Brian J. Sauser,et al.  Paradox: Holarchical view of system of systems engineering management , 2008, 2008 IEEE International Conference on System of Systems Engineering.

[5]  William A. Crossley,et al.  SYSTEM OF SYSTEMS: AN INTRODUCTION OF PURDUE UNIVERSITY SCHOOLS OF ENGINEERING’S SIGNATURE AREA , 2004 .

[6]  Peter Checkland,et al.  Systems Thinking, Systems Practice: Includes a 30-Year Retrospective , 1999 .

[7]  Wolter J. Fabrycky,et al.  Systems engineering and analysis , 1981 .

[8]  Jo Ann Lane,et al.  A Model of Systems Engineering in a System of Systems Context , 2009 .

[9]  Mark W. Maier.  HEURISTIC EXTRAPOLATION IN SYSTEM ARCHITECTURE , 1994 .

[10]  Azad M. Madni,et al.  Key challenges and opportunities in 'system of systems' engineering , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[11]  B. Berry.  Cities as systems within systems of cities , 1964 .

[12]  Lutz E. Schlange.  Scenarios: The art of strategic conversation , 1997 .

[13]  Michael Jackson,et al.  Towards a System of Systems Methodologies , 1984 .

[14]  C. Handy.  Balancing corporate power: a new Federalist paper. , 1992, Harvard business review.

[15]  Naomi L. Quenk,et al.  Essentials of Myers-Briggs Type Indicator Assessment , 1999 .

[16]  Russell L. Ackoff.  ‘whole‐ing’ the parts and righting the wrongs , 2007 .

[17]  Michael Jackson,et al.  Systems Thinking: Creative Holism for Managers , 2003 .

[18]  K. Perreault,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2011 .

[19]  Andrew P. Sage,et al.  On the Systems Engineering and Management of Systems of Systems and Federations of Systems , 2001, Inf. Knowl. Syst. Manag..

[20]  Anette J. Kriengle.  Behind the Wizard's Curtain: An Integration Environment for a System of Systems , 1999 .

[21]  Peter Checkland,et al.  Systems Thinking, Systems Practice , 1981 .

[22]  Peter C. Bishop,et al.  The current state of scenario development: an overview of techniques , 2007 .

[23]  Howard B. Lee,et al.  A First Course in Factor Analysis 2nd Ed , 1973 .

[24]  G. Rabadi,et al.  System of systems engineering , 2003, IEEE Engineering Management Review.

[25]  Pamela Jordan.  Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[26]  W. Ashby,et al.  Principles of the self-organizing dynamic system. , 1947, The Journal of general psychology.

[27]  Robert Cloutier,et al.  Applying Frameworks to Manage SoS Architecture , 2008 .

[28]  Christine R. Williams,et al.  Behavioral competencies of highly regarded systems engineers at NASA , 2009, 2009 IEEE Aerospace conference.

[29]  Brian J. Sauser,et al.  System of Systems Management: A Network Management Approach , 2007, 2007 IEEE International Conference on System of Systems Engineering.

[30]  John Boardman,et al.  Systems Thinking: Coping with 21st Century Problems , 2008 .

[31]  Adam M. Ross,et al.  A Framework for Tradespace Exploration of Systems of Systems , 2008 .

[32]  R. Ackoff.  Towards a System of Systems Concepts , 1971 .

[33]  James W. Carey,et al.  Linking Qualitative and Quantitative Methods: Integrating Cultural Factors into Public Health , 1993 .

[34]  Albert B. Cherns,et al.  The Principles of Sociotechnical Design , 1976 .

[35]  S. H. Appelbaum,et al.  The case for case studies in management research , 2003 .

[36]  W. Scott.  Organization Theory: An Overview and an Appraisal , 1961 .

[37]  Kevin MacG. Adams.  Systems principles: foundation for the SoSE methodology , 2011, Int. J. Syst. Syst. Eng..

[38]  Derek K. Hitchins,et al.  Putting Systems to Work , 1993 .

[39]  Charles B. Keating,et al.  Systems of systems engineering: prospects and challenges for the emerging field , 2011, Int. J. Syst. Syst. Eng..

[40]  Howard Eisner,et al.  Computer-aided system of systems (S2) engineering , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[41]  Joseph Kasser.  The acquisition of a System of Systems is just a simple multi-phased parallel-processing paradigm , 2002, IEEE International Engineering Management Conference.

[42]  Andres Sousa-Poza,et al.  Complex situations: An alternative approach for viewing a System of Systems , 2008, 2008 IEEE International Conference on System of Systems Engineering.

[43]  Charles B. Keating,et al.  System requirements engineering in complex situations , 2012, Requirements Engineering.

[44]  Behrokh Khoshnevis,et al.  Whole-brain thinking in systems architecting , 2009 .

[45]  H. Eisner,et al.  A systems engineering approach to architecting a unified system of systems , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[46]  Leonard A. Wojcik,et al.  Systems of systems engineering in the enterprise context: a unifying framework for dynamics , 2006, 2006 IEEE/SMC International Conference on System of Systems Engineering.

[47]  Andres Sousa-Poza,et al.  System of systems engineering: an emerging multidiscipline , 2008, Int. J. Syst. Syst. Eng..

[48]  Cihan H. Dagli,et al.  System of Systems Architecting , 2008 .

[49]  Cihan H. Dagli,et al.  Taxonomy of Systems-of-Systems , 2005 .

[50]  Daniel DeLaurentis,et al.  Understanding Transportation as a System-of-Systems Design Problem , 2005 .

[51]  A. J. Grimes.  Normal Accidents: Living with High Risk Technologies , 1985 .

[52]  Jim Wessel.  Autonomy and Interoperability in System of Systems Requirements Development Ira Monarch , 2005 .

[53]  K. Charmaz,et al.  Constructing Grounded Theory , 2014 .

[54]  Howard Eisner,et al.  RCASSE: Rapid Computer‐Aided System of Systems (S2) Engineering , 1993 .

[55]  Alex Gorod,et al.  System of Systems Management , 2008 .

[56]  R. Gonzalez.  Applied Multivariate Statistics for the Social Sciences , 2003 .

[57]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[58]  Willis Harman,et al.  An incomplete guide to the future , 1979 .

[59]  B. Glaser.  Theoretical Sensitivity: Advances in the Methodology of Grounded Theory , 1978 .

[60]  B. Everitt,et al.  Exploratory Factor Analysis , 2011 .

[61]  M. Bjelkemyr,et al.  An Engineering Systems Perspective on System of Systems Methodology , 2007, 2007 1st Annual IEEE Systems Conference.

[62]  Mark W. Maier,et al.  Architecting Principles for Systems‐of‐Systems , 1996 .

[63]  David H. Mason.  Tailoring scenario planning to the company culture , 2003 .

[64]  Robert E. Fenton,et al.  1 Agency‐level Systems Engineering for “Systems of Systems” , 1999 .

[65]  Pin Chen,et al.  Advancing systems engineering for systems‐of‐systems challenges , 2003 .

[66]  Julia Frankfurter.  Please Understand Me Ii Temperament Character Intelligence , 2016 .

[67]  D. S. Moore,et al.  Statistiek in de praktijk , 2001 .

[68]  Charles B. Keating,et al.  Complex system governance: concept, challenges, and emerging research , 2014, Int. J. Syst. Syst. Eng..

[69]  John O. Clark.  System of Systems Engineering and Family of Systems Engineering from a standards, V-Model, and Dual-V Model perspective , 2009, 2009 3rd Annual IEEE Systems Conference.

[70]  G. Weinberg.  An Introduction to General Systems Thinking , 1975 .

[71]  Mo Mansouri,et al.  Applications of systems thinking for resilience study in Maritime Transportation System of Systems , 2009, 2009 3rd Annual IEEE Systems Conference.

[72]  Stephen J. Lukasik,et al.  Systems, systems of systems, and the education of engineers , 1998, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[73]  Ricardo Valerdi,et al.  Synthesizing SoS concepts for use in cost modeling , 2007 .

[74]  Gordon W. Allport,et al.  The functional autonomy of motives. , 1937 .

[75]  Oleg V. Sindiy,et al.  Improved Decision Support in Space Exploration via System-of-Systems Analysis , 2007, 2007 IEEE International Conference on System of Systems Engineering.

[76]  Brian J. Sauser,et al.  Modeling the characteristics of system of systems , 2009, 2009 IEEE International Conference on System of Systems Engineering (SoSE).

[77]  Judith S. Dahmann,et al.  Process evolution to support system of systems engineering , 2008, ULSSIS '08.

[78]  Charles B. Keating,et al.  Research foundations for system of systems engineering , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[79]  Daniel E. Hastings,et al.  Systems of Systems and Emergent System Context , 2007 .

[80]  Salvatore R. Maddi,et al.  Personality Theories: A Comparative Analysis , 1976 .

[81]  Brian J. Sauser,et al.  System of Systems Collaborative Formation , 2010, IEEE Systems Journal.

[82]  F. Myrick,et al.  Grounded Theory: An Exploration of Process and Procedure , 2006, Qualitative health research.

[83]  Steven Johnson,et al.  Emergence: The Connected Lives of Ants, Brains, Cities, and Software , 2001 .

[84]  Herman Kahn,et al.  Thinking about the unthinkable , 1962 .

[85]  P. Senge.  THE FIFTH DISCIPLINE , 1997 .

[86]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[87]  Charles B. Keating,et al.  Perspective 2 of the SoSE methodology: designing the unique methodology , 2011, Int. J. Syst. Syst. Eng..

[88]  P. A. ― Trisha.  If You Want Good Systems Engineers, Sometimes You Have To Grow Your Own! , 2007 .

[89]  Alex Gorod,et al.  Flexibility of System of Systems , 2008 .

[90]  P. Sridhar,et al.  Towards optimization of a real-world Robotic-Sensor System of Systems , 2006, 2006 World Automation Congress.

[91]  Andres Sousa-Poza,et al.  System of systems engineering , 2003, IEEE Engineering Management Review.

[92]  Michael Jackson,et al.  The System of Systems Methodologies: A Guide to Researchers , 1993 .

[93]  Barry Boehm,et al.  System of systems lead system integrators: Where Do they spend their time and what makes them more or less efficient? , 2008 .

[94]  Paul G. Carlock,et al.  System of Systems (SoS) enterprise systems engineering for information‐intensive organizations , 2001 .

[95]  Charles B. Keating,et al.  Overview of the systems of systems engineering methodology , 2011, Int. J. Syst. Syst. Eng..

[96]  Oleg V. Sindiy,et al.  Developing Sustainable Space Exploration via a System-of-Systems Approach , 2006 .

[97]  Sarah A. Sheard,et al.  Principles of complex systems for systems engineering , 2009 .

[98]  Aaron J. Shenhar,et al.  The new taxonomy of systems: toward an adaptive systems engineering framework , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[99]  Zhong Liu,et al.  A planning support system for system of systems engineering , 2007, 2007 IEEE International Conference on Industrial Engineering and Engineering Management.

[100]  Stephen C. Cook.  2.3.1 On the Acquisition of Systems of Systems , 2001 .

[101]  John Boardman,et al.  Taking Hold of System of Systems Management , 2008 .

[102]  Ben Horan,et al.  System of systems approach to threat detection and integration of heterogeneous independently operable systems , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[103]  James K. Feibleman.  On the Theory of Induction , 1954 .

[104]  Jaroslaw Sobieszczanski-Sobieski,et al.  Integrated System-of-Systems Synthesis (ISSS) , 2006 .

[105]  Judith Dahmann.  Key System of Systems Engineering Artifacts to Guide Engineering Activities , 2010 .

[106]  Derek K. Hitchins.  Advanced Systems Thinking, Engineering, and Management , 2003 .

[107]  John P. Robinson,et al.  Futures under glass , 1990 .

[108]  I. B. Myers.  Manual: A Guide to the Development and Use of the Myers-Briggs Type Indicator , 1985 .

[109]  Moti Frank,et al.  Knowledge, abilities, cognitive characteristics and behavioral competences of engineers with high capacity for engineering systems thinking (CEST) , 2006, IEEE Engineering Management Review.

[110]  Vadim Kotov,et al.  Systems of systems as communicating structures , 1999 .

[111]  M. Frank,et al.  Characteristics of engineering systems thinking - a 3D approach for curriculum content , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[112]  K. Boulding.  General Systems Theory---The Skeleton of Science , 1956 .

[113]  Adam M. Ross,et al.  A framework for evolving system of systems engineering , 2007 .

[114]  G. Rebovich,et al.  The Evolution of Systems Engineering , 2008, 2008 2nd Annual IEEE Systems Conference.

[115]  Toni Rietveld,et al.  Statistical Techniques for the Study of Language and Language Behaviour , 1993 .

[116]  P. B. Cunningham.  Improved communication and teamwork through use of Myers-Briggs type indicator , 2000, Proceedings 1st Austin Workshop on Engineering Management in Technology-Based Organizations.

[117]  Brian J. Sauser,et al.  System of Systems - the meaning of of , 2006, 2006 IEEE/SMC International Conference on System of Systems Engineering.

[118]  Graham R. Gibbs,et al.  Analyzing Qualitative Data , 2014 .

[119]  I. B. Myers.  The Myers-Briggs Type Indicator: Manual (1962). , 1962 .

[120]  Mo M. Jamshidi,et al.  A Discrete Event XML based Simulation Framework for System of Systems Architectures , 2007, 2007 IEEE International Conference on System of Systems Engineering.

[121]  Andrew P. Sage,et al.  Engineering of a System of Systems , 2008 .

[122]  Elizabeth C. L. Starrett.  Managing Requirements for a System of Systems , 2004 .

[123]  Daniel DeLaurentis,et al.  A System-of-Systems Perspective for Public Policy Decisions , 2004 .

[124]  William A. Owens,et al.  The Emerging U.S. System-of-Systems , 1996 .

[125]  Marcus Bjelkemyr,et al.  Definition, classification, and methodological issues of system of systems , 2008 .

[126]  Jose J. Padilla,et al.  System of Systems Engineering Requirements: Challenges and Guidelines , 2008 .

[127]  Ben Clegg,et al.  Systems of systems:pure and applied to Lean Six Sigma training , 2012 .

[128]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[129]  Mohammad Jamshidi,et al.  System of systems engineering : innovations for the 21st century , 2008 .

[130]  Andrew P. Sage,et al.  System of systems integration and test , 2006, Inf. Knowl. Syst. Manag..

[131]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[132]  Ewart R. Carson,et al.  Dealing with Complexity , 1988, Springer US.

[133]  Barry Clemson,et al.  Cybernetics : a new management tool , 1984 .

[134]  George Wright,et al.  The origins and evolution of scenario techniques in long range business planning , 2005 .

[135]  Daniel DeLaurentis,et al.  A taxonomy-based perspective for systems of systems design methods , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[136]  Craig Bonaceto,et al.  6.1.2 Using Cognitive Engineering to Improve Systems Engineering , 2006 .