Engineered Resilient Systems: Knowledge Capture and Transfer

Abstract : This research is motivated by the defense-related industry and government of the aging workforce. Within the project, the research team gathered expert knowledge and synthesized emerging engineering resilient systems (ERS)-related research, toward a goal of enabling novices to have expert-like decision capability through encoded knowledge and data-driven tradespace analysis framework and integrated tool suite. Additionally tradespace exploration was investigated as boundary objects enabling cross-domain communication and facilitating decision making for complex systems. The team investigated briefings and literature related to ERS and tradespace exploration. Multiple discussions were held with government leaders, university researchers, practitioners. After identifying key ERS artifacts, the team mapped these artifacts to the MPTs derived from the knowledge and information gathered. Having to use an alternative approach, the research team was able to generate some observations based on limited data availability to two Navy tradespace exploration activities. Based on the results of the information gathering and observed exploration case studies, the research team developed some initial requirements for designing a larger full scale case study. The research team enumerated some potential gaps and findings, along with suggested enablers for consideration in evolving the ERS framework and tool suite environment in support of its tradespace analysis goals.

[1]  Adam M. Ross,et al.  An Approach for System of Systems Tradespace Exploration , 2014 .

[2]  Jarret M. Lafleur,et al.  Exploring the F6 Fractionated Spacecraft Trade Space with GT-FAST , 2009 .

[3]  Daniel E. Hastings,et al.  Assessing Changeability in Aerospace Systems Architecting and Design Using Dynamic Multi-Attribute Tradespace Exploration , 2006 .

[4]  Azad M. Madni,et al.  Towards affordably adaptable and effective systems , 2013, Syst. Eng..

[5]  M. E. Fitzgerald,et al.  Mitigating contextual uncertainties with valuable changeability analysis in the multi-epoch domain , 2012, 2012 IEEE International Systems Conference SysCon 2012.

[6]  Adam M. Ross,et al.  Design for Affordability in Complex Systems and Programs Using Tradespace-based Affordability Analysis , 2014, CSER.

[7]  David Richard Wolf AN ASSESSMENT OF NOVICE AND EXPERT USERS’ DECISION-MAKING STRATEGIES DURING VISUAL TRADE SPACE EXPLORATION , 2009 .

[8]  Timothy W. Simpson,et al.  A Preliminary Study of Novice and Expert Users' Decision-Making Procedures during Visual Trade Space Exploration , 2009, DAC 2009.

[9]  Timothy W. Simpson,et al.  Visual Steering Commands for Trade Space Exploration: User-Guided Sampling With Example , 2009, J. Comput. Inf. Sci. Eng..

[10]  Michael J. Sullivan Defense Acquisitions. Many Analyses of Alternatives Have Not Provided a Robust Assessment of Weapon System Options , 2009 .

[11]  George A. Hazelrigg,et al.  Validation of engineering design alternative selection methods , 2003 .

[12]  M. E. Fitzgerald,et al.  Sustaining lifecycle value: Valuable changeability analysis with era simulation , 2012, 2012 IEEE International Systems Conference SysCon 2012.

[13]  Matthew E. Fitzgerald,et al.  Exploring Stakeholder Value Models via Interactive Visualization , 2014, CSER.

[14]  Eric Spero,et al.  Tradespace Exploration for the Engineering of Resilient Systems , 2014, CSER.

[15]  Adam M. Ross Multi-attribute Tradespace Exploration , 2005 .

[16]  Alek Gavrilovski,et al.  The Capability Assessment and Tradeoff Environment (CATE) for Advanced Aerospace Vehicle and Technology Assessment , 2014, CSER.

[17]  Jay D. Martin,et al.  The ARL Trade Space Visualizer: An Engineering Decision-Making Tool , 2004 .

[18]  Dimitri N. Mavris,et al.  An Overview of Design Challenges and Methods in Aerospace Engineering , 2011, CSDM.

[19]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[20]  Daniel E. Hastings,et al.  Responsive Systems Comparison Method: Case Study in Assessing Future Designs in the Presence of Change , 2008 .

[21]  Erik K. Antonsson,et al.  Imprecision in Engineering Design , 1995 .

[22]  Adam M. Ross,et al.  Aligning Perspectives and Methods for Value-Driven Design , 2010 .

[23]  Daniel E. Hastings,et al.  Role for Interactive Tradespace Exploration in Multi- Stakeholder Negotiations , 2010 .

[24]  Chun Wei Choo Environmental scanning as information seeking and organizational learning , 2001, Inf. Res..

[25]  Olivier L. de Weck,et al.  Time-expanded decision networks: A framework for designing evolvable complex systems , 2007 .

[26]  Adam M. Ross,et al.  11.1.1 Using Natural Value-Centric Time Scales for Conceptualizing System Timelines through Epoch-Era Analysis , 2008 .

[27]  G.M. Stump,et al.  Trade space exploration of satellite datasets using a design by shopping paradigm , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[28]  Adam Michael Ross,et al.  Multi-attribute tradespace exploration with concurrent design as a value-centric framework for space system architecture and design , 2003 .

[29]  Rick Kazman,et al.  Toward a discipline of scenario‐based architectural engineering , 2000, Ann. Softw. Eng..

[30]  Joseph H. Saleh,et al.  Beyond Cost and Performance, a Value -Centric Framework and Pareto Optimization for Communication Satellites * , 2009 .

[31]  Daniel E. Hastings,et al.  Revisiting the Tradespace Exploration Paradigm: Structuring the Exploration Process , 2010 .

[32]  David H. Laananen,et al.  The Genetic Algorithm as an Automated Methodology for Helicopter Conceptual Design , 1997 .

[33]  Caroline Marie Lamb,et al.  Collaborative systems thinking : an exploration of the mechanisms enabling team systems thinking , 2009 .

[34]  Matthew E. Fitzgerald,et al.  Architecting Systems of Systems with Ilities: An Overview of the SAI Method , 2014, CSER.

[35]  Tom Ritchey Scenario Development and Risk Management Using Morphological Field Analysis: Research in Progress , 1997, ECIS.

[36]  Ralph L. Keeney,et al.  Value-Focused Thinking: A Path to Creative Decisionmaking , 1992 .

[37]  Daniel E. Hastings,et al.  Multi-attribute tradespace exploration for survivability , 2013 .

[38]  Brian German,et al.  RAVE: A Graphically Driven Framework for Agile Design-Decision Support , 2010 .

[39]  Robert Neches Engineered Resilient Systems (ERS) S&T Priority Description and Roadmap , 2011 .

[40]  Gregory S. Parnell,et al.  4.3.1 Systems Engineering Tradeoff Study Process Framework , 2014 .

[41]  Matthew E. Fitzgerald,et al.  Controlling for Framing Effects in Multi-stakeholder Tradespace Exploration , 2014, CSER.

[42]  D. Rhodes,et al.  Enabling Design for Affordability: An Epoch-Era Analysis Approach , 2013 .

[43]  Forrest Shull,et al.  Evaluation of Systems Engineering Methods, Processes and Tools on Department of Defense and Intelligence Community Programs. Phase 1 , 2009 .

[44]  M.A. Jones,et al.  Conceptual Design Methods and the Application of a Tradespace Modeling Tool for Deep Space Missions , 2008, 2008 IEEE Aerospace Conference.

[45]  Farrokh Mistree,et al.  Statistical Approximations for Multidisciplinary Design Optimization: The Problem of Size , 1999 .

[46]  Robert Neches Engineered Resilient Systems: A DoD Science and Technology Priority Area , 2012 .

[47]  Adam M. Ross,et al.  A Research Agenda for Tradespace Exploration and Analysis of Engineered Resilient Systems , 2014, CSER.

[48]  Patrick J. Driscoll,et al.  Decision Making in Systems Engineering and Management , 2007 .

[49]  Robert Kane,et al.  Taming the Tigers: Recapturing the Acquisition Excellence of Our Planning, Programming, and Acquisition Three-Ring Circus , 2013 .

[50]  William Ribarsky Comparing Usage Patterns of Domain Experts and Novices in Visual Analytical Tasks , 2009 .

[51]  Wei Chen,et al.  A CONCEPT EXPLORATION METHOD FOR DETERMINING ROBUST TOP-LEVEL SPECIFICATIONS , 1996 .

[52]  Rachel Schutt,et al.  Doing Data Science , 2013 .

[53]  Michael Andrew Schaffner,et al.  Designing systems for many possible futures : the RSC-based method for affordable concept selection (RMACS), with multi-era analysis , 2014 .

[54]  C.T. Lamb,et al.  Empirical Research on Systems Thinking and Practice in the Engineering Enterprise , 2008, 2008 2nd Annual IEEE Systems Conference.

[55]  Haifeng Zhu,et al.  META II Complex Systems Design and Analysis (CODA) , 2011 .

[56]  Adam M. Ross,et al.  Responsive systems comparison method: Dynamic insights into designing a satellite radar system , 2009 .

[57]  Adam M. Ross,et al.  The Tradespace Exploration Paradigm , 2005 .

[58]  Matthias Gries,et al.  Methods for evaluating and covering the design space during early design development , 2004, Integr..

[59]  S. R. Watson,et al.  Decision Synthesis: The Principles and Practice of Decision Analysis@@@Strategic and Tactical Decisions , 1989 .

[60]  Dimitri N. Mavris,et al.  Concept Selection Using an Interactive Reconfigurable Matrix of Alternatives (IRMA) , 2007 .