Towards Risk Based Design (RBD) of Space Exploration Missions: A Review of RBD Practice and Research Trends at NASA

This paper describes the concept of Risk Based Design in the context of NASA’s low volume, high cost missions. The issue of accounting for risk in the design lifecycle has been heavily discussed in the literature under several research topics, including: reliability, risk and uncertainty analysis, optimization, decision-based design and robust design. Due to the risky nature of space missions, NASA centers have adopted a variety of techniques ‐ developing tools, procedures, and guidelines to mitigate risk. Most of these techniques, however, require significant amounts of detailed and possibly quantitative information, making them inapplicable to early stages of design, where the requirements and models are vague, decisions are tentative and probabilities are unknown. This survey paper first presents a brief description of a design environment at NASA as well as current risk-based design practices and methods. Then, a summary of the topics from the NASA’s Risk Management efforts is presented, followed by current research efforts within NASA to account for risk in the early stages of design. The purpose of this paper is provide a survey of NASA’s capabilities (or lack thereof) in accounting for risk in the early design phase. This work lays the foundation for more effective collaborations between NASA researchers and academic research community.

[1]  Irem Y. Tumer,et al.  Linking product functionality to historic failures to improve failure analysis in design , 2005 .

[2]  Xuan Chen,et al.  VISUALIZING THE OPTIMIZATION PROCESS IN REAL-TIME USING PHYSICAL PROGRAMMING , 1998 .

[3]  Denis Lalanne,et al.  Design visual thinking tools for mixed initiative systems , 2002, IUI '02.

[4]  Terry O. Tri,et al.  Reducing the Risk of Human Space Missions With INTEGRITY , 2003 .

[5]  Eliot Winer,et al.  Development of visual design steering as an aid in large-scale multidisciplinary design optimization. Part I: method development , 2002 .

[6]  John E. Renaud,et al.  Interactive multiobjective optimization of engineering systems , 1999 .

[7]  Natasha Smith,et al.  System Risk Assessment and Allocation in Conceptual Design , 2003 .

[8]  Sobieszczanski Jaroslaw,et al.  Advancement of Bi-Level Integrated System Synthesis (BLISS) , 2000 .

[9]  Martin S. Feather,et al.  Quantitative risk-based requirements reasoning , 2003, Requirements Engineering.

[10]  Christian Smart,et al.  Reliability/risk analysis methods and design tools for application in space programs , 1998 .

[11]  Pratyush Kumar,et al.  User-Involved Tradeoff Analysis in Configuration Tasks , 2003 .

[12]  Farrokh Mistree,et al.  DECISIONS UNDER UNCERTAINTY: THE FUZZY COMPROMISE DECISION SUPPORT PROBLEM , 1992 .

[13]  Ralph E. Steuer,et al.  Multiple Objectives in Portfolio Selection , 2005 .

[14]  Daniel A. Keim,et al.  Information Visualization and Visual Data Mining , 2002, IEEE Trans. Vis. Comput. Graph..

[15]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[16]  Bruce A. Conway,et al.  Development of an Expert Judgement Elicitation and Calibration Methodology for Risk Analysis in Conceptual Vehicle Design , 2004 .

[17]  Kemper Lewis,et al.  Visualization of multidimensional design and optimization data using cloud visualization , 2002, DAC 2002.

[18]  Martin S. Feather,et al.  A quantitative risk model for early lifecycle decision making , 2002 .

[19]  Joe Marks,et al.  Human-Guided Simple Search , 2000, AAAI/IAAI.

[20]  Jie Cheng,et al.  Demand analysis for decision-based design of vehicle engine , 2004 .

[21]  L.P. Chao,et al.  Design process error-proofing: benchmarking the NASA development life-cycle , 2005, 2005 IEEE Aerospace Conference.

[22]  J. Rose Risk Management for Jet Propulsion Laboratory Flight Projects , 2000 .

[23]  Timothy W. Simpson,et al.  Multidimensional Visualization and Its Application to a Design by Shopping Paradigm , 2002 .

[24]  Marc Despontin,et al.  Multiple Criteria Optimization: Theory, Computation, and Application, Ralph E. Steuer (Ed.). Wiley, Palo Alto, CA (1986) , 1987 .

[25]  Susie Go,et al.  A Top-down Risk Assessment Tool for a Reusable Launch Vehicle Development Program , 2003 .

[26]  Xiaoping Du,et al.  Efficient Uncertainty Analysis Methods for Multidisciplinary Robust Design , 2002 .

[27]  Irem Y. Tumer,et al.  ANALYTICAL METHOD FOR MAPPING FUNCTION TO FAILURE DURING HIGH-RISK COMPONENT DEVELOPMENT , 2001 .

[28]  Eric T. Martin,et al.  Multiobjective Aircraft Design to Investigate Potential Geometric Morphing Features , 2002 .

[29]  Irem Y. Tumer,et al.  A NEW APPROACH TO PROBABILISTIC RISK ANALYSIS IN CONCURRENT AND DISTRIBUTED DESIGN OF AEROSPACE SYSTEMS , 2005, DAC 2005.

[30]  Jaroslaw Sobieszczanski-Sobieski,et al.  Multidisciplinary aerospace design optimization - Survey of recent developments , 1996 .

[31]  Joseph R. Fragola,et al.  A risk evaluation approach for safety in aerospace preliminary design , 2003, Annual Reliability and Maintainability Symposium, 2003..

[32]  R. W. Mayne,et al.  Interactive computer methods for design optimization , 1979 .

[33]  Natasha Smith,et al.  Probabilistic Methods for Aerospace System Conceptual Design , 2002 .

[34]  J. F. Clawson,et al.  The lessons learned process: an effective countermeasure against avoidable risk , 2001, Annual Reliability and Maintainability Symposium. 2001 Proceedings. International Symposium on Product Quality and Integrity (Cat. No.01CH37179).

[35]  Janet K. Allen,et al.  THE DECISION TO INTRODUCE NEW TECHNOLOGY: THE FUZZY PRELIMINARY SELECTION DECISION SUPPORT PROBLEM , 1996 .

[36]  Matthew O. Ward,et al.  XmdvTool: integrating multiple methods for visualizing multivariate data , 1994, Proceedings Visualization '94.

[37]  Steven L. Cornford,et al.  Risk based decision tool for space exploration missions , 2003 .

[38]  Xuan Chen,et al.  Visualizing the optimization process in real-time using physical programming , 1998 .

[39]  Farrokh Mistree,et al.  DECISION-BASED DESIGN - A CONTEMPORARY PARADIGM FOR SHIP DESIGN , 1990 .

[40]  Timothy W. Simpson,et al.  Design Space Visualization and Its Application to a Design by Shopping Paradigm , 2003, DAC 2003.

[41]  M. S. Feather,et al.  A quantitative risk-based model for reasoning over critical system properties , 2002 .

[42]  Robert Stone,et al.  Product Design Support: Exploring a Design Repository System , 2004 .

[43]  Irem Y. Tumer,et al.  The function-failure design method , 2005 .

[44]  Irem Y. Tumer,et al.  Mapping function to failure mode during component development , 2003 .

[45]  Martin S. Feather,et al.  Traceability and Decision Capture in Semi-structured Contexts , 2003, SEKE.

[46]  Alex T. Pang,et al.  Glyphs for Visualizing Uncertainty in Vector Fields , 1996, IEEE Trans. Vis. Comput. Graph..

[47]  Alan J. Dix,et al.  Starting simple: adding value to static visualisation through simple interaction , 1998, AVI '98.

[48]  C. Bloebaum,et al.  Development of visual design steering as an aid in large-scale multidisciplinary design optimization. Part II: method validation , 2002 .

[49]  Irem Y. Tumer,et al.  Design Process Error-Proofing: Engineering Peer Review Lessons From NASA , 2004 .