Characterizing Representational Uncertainty in System Design and Operations

This paper develops the concept of representational uncertainty to frame a critical challenge in systems engineering. Representational uncertainty arises in complex systems problems when the correct system representation cannot practically be known until some initial work has been undertaken. Drawing on empirical evidence from two very different system design problems, we illustrate the nature and prevalence of representational uncertainty in systems engineering practice. Our findings show that errors in the system representation may lead to wasted design work that explores the wrong tradespaces, expects the wrong value from design choices, and organizes work on the wrong set of decomposed subproblems. We find that mitigating representational uncertainty requires design processes that incorporate discovery of the system properties through a "reality check" early in the design process. We consider the implications for systems engineering processes and tools, and highlight directions for future research.

[1]  Kathleen M. Eisenhardt,et al.  Theory Building From Cases: Opportunities And Challenges , 2007 .

[2]  Kim B. Clark,et al.  Product development performance : strategy, organization, and management in the world auto industry / Kim B. Clark, Tahahiro Fujimoto , 1991 .

[3]  Daniel P. Thunnissen,et al.  Uncertainty Classification for the Design and Development of Complex Systems , 2003 .

[4]  A. Langley Strategies for Theorizing from Process Data , 1999 .

[5]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[6]  Jarrod Goentzel,et al.  Case study of a humanitarian logistics simulation exercise and insights for training design , 2015 .

[7]  Kim B. Clark,et al.  Design Rules: The Power of Modularity , 2000 .

[8]  Edward F. Crawley,et al.  Divergence and lifecycle offsets in product families with commonality , 2013, Syst. Eng..

[9]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[10]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[11]  Charles H. Fine,et al.  Problem Formulation and Solution Mechanisms: A Behavioral Study of Humanitarian Transportation Planning , 2016 .

[12]  George E. P. Box,et al.  Sampling and Bayes' inference in scientific modelling and robustness , 1980 .

[13]  Daniel E. Hastings,et al.  Measuring the Value of Flexibility in Space Systems: A Six-Element Framework: Regular Papers , 2007 .

[14]  Zoe Szajnfarber,et al.  Managing Innovation in Architecturally Hierarchical Systems: Three Switchback Mechanisms That Impact Practice , 2014, IEEE Transactions on Engineering Management.

[15]  Zoe Szajnfarber,et al.  A process model of technology innovation in governmental agencies: Insights from NASA’s science directorate , 2013 .

[16]  Kevin Forsberg,et al.  The Relationship of System Engineering to the Project Cycle , 1991 .

[17]  P. John Clarkson,et al.  Change and customisation in complex engineering domains , 2004 .

[18]  Christiaan J. J. Paredis,et al.  An Investigation Into the Decision Analysis of Design Process Decisions , 2010 .

[19]  David D. Walden,et al.  Systems engineering handbook : a guide for system life cycle processes and activities , 2015 .

[20]  Zoe Szajnfarber,et al.  When Policy Structures Technology: Balancing upfront decomposition and in-process coordination in Europe׳s decentralized space technology ecosystem ☆ , 2015 .

[21]  Daniel E. Hastings,et al.  Defining changeability: Reconciling flexibility, adaptability, scalability, modifiability, and robustness for maintaining system lifecycle value , 2008 .

[22]  Daniel E. Hastings,et al.  Multi-Attribute Tradespace Exploration as Front End for Effective Space System Design , 2004 .

[23]  Babak Heydari,et al.  From Modular to Distributed Open Architectures: A Unified Decision Framework , 2016, Syst. Eng..

[24]  K. Eisenhardt Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[25]  Jarrod Goentzel,et al.  Humanitarian transportation planning: Evaluation of practice-based heuristics and recommendations for improvement , 2018, Eur. J. Oper. Res..

[26]  David M. Anderson Design for Manufacturability: How to Use Concurrent Engineering to Rapidly Develop Low-Cost, High-Quality Products for Lean Production , 2014 .

[27]  Eun Suk Suh,et al.  Seeing Complex System through Different Lenses: Impact of Decomposition Perspective on System Architecture Analysis , 2015, Syst. Eng..

[28]  Gareth W. Parry,et al.  The characterization of uncertainty in probabilistic risk assessments of complex systems , 1996 .

[29]  Charles H. Fine,et al.  Assessing Trade‐offs among Multiple Objectives for Humanitarian Aid Delivery Using Expert Preferences , 2014 .

[30]  Eun Suk Suh,et al.  Flexible product platforms: framework and case study , 2007, DAC 2006.

[31]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[32]  John E. Renaud,et al.  Uncertainty quantification using evidence theory in multidisciplinary design optimization , 2004, Reliab. Eng. Syst. Saf..

[33]  Ron Sanchez,et al.  Modularity, flexibility, and knowledge management in product and organization design , 1996 .

[34]  Kim B. Clark,et al.  Design Rules: The Power of Modularity Volume 1 , 1999 .

[35]  Kathleen V. Diegert,et al.  Error and uncertainty in modeling and simulation , 2002, Reliab. Eng. Syst. Saf..

[36]  Annalisa L. Weigel,et al.  Assessing Fractionated Spacecraft Value Propositions for Earth Imaging Space Missions , 2011 .

[37]  Christiaan J. J. Paredis,et al.  Designing Design Processes in Product Lifecycle Management: Research Issues and Strategies , 2004 .

[38]  Eun Suk Suh,et al.  Technology infusion for complex systems: A framework and case study , 2010 .

[39]  Daniel E. Hastings,et al.  Measuring the Value of Flexibility in Space Systems: A Six‐Element Framework , 2007, Syst. Eng..

[40]  Armin P. Schulz,et al.  Design for changeability (DfC): Principles to enable changes in systems throughout their entire lifecycle , 2005 .

[41]  Daniel A. Levinthal,et al.  Modularity and Innovation in Complex Systems , 2002, Manag. Sci..