Factors that Influence the Acceptance of New Aerospace Risk Assessment Techniques

With the rise of new space missions such as NASA’s Dragonfly that will include a nuclearpowered rotorcraft for exploring Saturn’s icy moon, Titan, as well as deep space missions that cannot rely on solar power, new risk assessment strategies are needed that balance the need for safety against the impracticality of lifetime testing. Risk assessments for existing nuclear technologies and, more broadly, safety-critical systems can widely vary in approaches and outcomes, with significant cultural influences. Some safety-critical systems like driverless cars and surgical robots have been authorized to operate with little or highly questionable risk assessments. Others using well-established probabilistic-based risk assessment methods such as those used for Stirling-based convertors for Radioisotope Thermoelectric Generators have struggled to convince relevant agencies that risk is acceptable. Case studies show that riskaverse oversight groups tend to rely more on concepts of heritage for technology risk assessments, which is the existence of either observed data from actual or similar operational systems. While reliance in heritage may reduce risk, it can result in incremental, evolutionary technologies instead of revolutionary ones, in effect stifling innovation. This notion of heritage can also lead to a misperception of acceptable risk under the guise of a regulatory concept termed equivalence, which allows new technologies to be fielded based on erroneous technical comparisons, much like the Boeing 737 MAX. More work is needed to understand the interplay between probabilistic-based risk assessments, notions of equivalence and heritage, and the culture of oversight agencies.

[1]  David Britton,et al.  Regulating safety-critical autonomous systems: past, present, and future perspectives , 2020 .

[2]  J. Dimick,et al.  Is It Time for Safeguards in the Adoption of Robotic Surgery? , 2019, JAMA.

[3]  Mary L. Cummings,et al.  Identifying and Mitigating Barriers to the Adoption of Dynamic Radioisotope Power Systems for Space Flight , 2019, 2019 IEEE Aerospace Conference.

[4]  Christopher J. Scolese,et al.  Valuing Rigor in the Risk Management Process , 2019, 2019 IEEE Aerospace Conference.

[5]  Russ Tedrake,et al.  Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation , 2018, NeurIPS.

[6]  Gary Marcus,et al.  Deep Learning: A Critical Appraisal , 2018, ArXiv.

[7]  Ding Zhao,et al.  From the Lab to the Street: Solving the Challenge of Accelerating Automated Vehicle Testing , 2017, ArXiv.

[8]  Garrett Shea,et al.  NASA Systems Engineering Handbook Revision 2 , 2017 .

[9]  Nidhi Kalra,et al.  Driving to Safety , 2016 .

[10]  Philip Koopman,et al.  Challenges in Autonomous Vehicle Testing and Validation , 2016 .

[11]  David F. Woerner,et al.  A Progress Report on the eMMRTG , 2016, Journal of Electronic Materials.

[12]  Russell Bennett,et al.  Increasing the Efficiency of the Multi-mission Radioisotope Thermoelectric Generator , 2015, Journal of Electronic Materials.

[13]  Leila Meshkat Probabilistic risk assessment for decision making during spacecraft operations , 2009, 2009 Annual Reliability and Maintainability Symposium.

[14]  J. Wreathall,et al.  Assessing risk: the role of probabilistic risk assessment (PRA) in patient safety improvement , 2004, Quality and Safety in Health Care.

[15]  R. Ghaffarian,et al.  SIP qualification and PRA approaches , 2002 .

[16]  J. R. Rose Risk management at JPL-practices and promises , 2002, Proceedings, IEEE Aerospace Conference.

[17]  Hooshang Heshmat,et al.  Accelerated testing of space mechanisms , 1995 .

[18]  Pravin Varaiya,et al.  What's decidable about hybrid automata? , 1995, STOC '95.

[19]  J. March,et al.  Managerial perspectives on risk and risk taking , 1987 .

[20]  Henry Petroski,et al.  To Engineer is Human , 1985 .

[21]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[22]  J. Swanson,et al.  Accelerated life testing of spacecraft subsystems , 1972 .

[23]  G. Stigler The Theory of Economic Regulation , 2021, The Political Economy.