Validation of the Nasa Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM under-predicted the occurrence of ~10% of the modeled medical conditions for the STS missions and over-predicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all “mission type” data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

[1]  Aaron S Weaver,et al.  Predicting head injury risk during International Space Station increments. , 2013, Aviation, space, and environmental medicine.

[2]  Emily S. Nelson,et al.  Development and Validation of a Predictive Bone Fracture Risk Model for Astronauts , 2009, Annals of Biomedical Engineering.

[3]  K. V. Kumar,et al.  A probabilistic model of hypobaric decompression sickness based on 66 chamber tests. , 1996, Aviation, space, and environmental medicine.

[4]  A. Anis,et al.  Cost-effectiveness of hip protectors in the prevention of osteoporosis related hip fractures in elderly nursing home residents. , 2004, The Journal of rheumatology.

[5]  Jeffrey V Siebers,et al.  Comparisons of treatment optimization directly incorporating systematic patient setup uncertainty with a margin-based approach. , 2012, Medical physics.

[6]  Carol Coupland,et al.  Predicting risk of emergency admission to hospital using primary care data: derivation and validation of QAdmissions score , 2013, BMJ Open.

[7]  Afschin Gandjour,et al.  Cost-effectiveness of referrals to high-volume hospitals: An analysis based on a probabilistic Markov model for hip fracture surgeries , 2006, Health care management science.

[8]  A. Slonim,et al.  Assessing patient safety risk before the injury occurs: an introduction to sociotechnical probabilistic risk modelling in health care , 2003, Quality & safety in health care.

[9]  Marlei Walton,et al.  The Integrated Medical Model: A Probabilistic Simulation Model for Predicting In-Flight Medical Risks , 2015 .

[10]  Kimberly M Thompson,et al.  Variability and Uncertainty Meet Risk Management and Risk Communication , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[11]  P K Weathersby,et al.  Probabilistic models of the role of oxygen in human decompression sickness. , 1996, Journal of applied physiology.

[12]  Gwe-Ya Kim,et al.  A comparison of two prospective risk analysis methods: Traditional FMEA and a modified healthcare FMEA. , 2016, Medical physics.

[13]  Charles Maynard,et al.  Patient-Specific Predictions of Outcomes in Myocardial Infarction for Real-Time Emergency Use: A Thrombolytic Predictive Instrument , 1997, Annals of Internal Medicine.

[14]  S L Pool,et al.  Design and current status of the longitudinal study of astronaut health. , 2000, Aviation, space, and environmental medicine.

[15]  Jerry G. Myers,et al.  Bayesian Analysis for Risk Assessment of Selected Medical Events in Support of the Integrated Medical Model Effort , 2013 .

[16]  Eric L Kerstman,et al.  Space adaptation back pain: a retrospective study. , 2012, Aviation, space, and environmental medicine.

[17]  Jan B. Oostenbrink,et al.  Modelling the 5-year cost effectiveness of tiotropium, salmeterol and ipratropium for the treatment of chronic obstructive pulmonary disease in Spain , 2007, The European Journal of Health Economics.

[18]  Andrew Briggs,et al.  The use of probabilistic decision models in technology assessment , 2004, Applied health economics and health policy.

[19]  Elnaz Peyghaleh,et al.  Implementation of Equity in Resource Allocation for Regional Earthquake Risk Mitigation Using Two‐Stage Stochastic Programming , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[20]  L I Iezzoni,et al.  Predicting In-hospital Mortality for Stroke Patients , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[21]  Lacey Colligan,et al.  Assessing the validity of prospective hazard analysis methods: a comparison of two techniques , 2014, BMC Health Services Research.

[22]  Nasa.  Probabilistic Risk Assessment Procedures Guide for NASA Managers and Practitioners: Second Edition , 2018 .

[23]  Ping Zhang,et al.  Computer modeling of diabetes and its complications: a report on the Fifth Mount Hood challenge meeting. , 2007, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[24]  David B Matchar,et al.  Strategic Planning to Reduce the Burden of Stroke Among Veterans: Using Simulation Modeling to Inform Decision Making , 2014, Stroke.

[25]  A. Barker,et al.  Development and validation of a pressure ulcer risk assessment tool for acute hospital patients , 2011, Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society.

[26]  D T Zero,et al.  An overview of caries risk assessment, and its potential utility. , 1995, Journal of dental education.

[27]  Martin Pitt,et al.  The cost-utility of cinacalcet in addition to standard care compared to standard care alone for secondary hyperparathyroidism in end-stage renal disease: a UK perspective. , 2007, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[28]  Sergey Samorezov,et al.  An extravehicular suit impact load attenuation study to improve astronaut bone fracture prediction. , 2011, Aviation, space, and environmental medicine.

[29]  Sameer Kumar,et al.  A Modified Delphi Methodology to Conduct a Failure Modes Effects Analysis: A Patient-Centric Effort in a Clinical Medical Laboratory , 2011, Quality management in health care.

[30]  Jan B Oostenbrink,et al.  Probabilistic Markov model to assess the cost-effectiveness of bronchodilator therapy in COPD patients in different countries. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[31]  Amanda H. Salanitro,et al.  Risk prediction models for hospital readmission: a systematic review. , 2011, JAMA.

[32]  Arunkumar Pennathur,et al.  Modeling hospital response to mild and severe influenza pandemic scenarios under normal and expanded capacities. , 2007, Military medicine.

[33]  Charles H Mathers,et al.  Musculoskeletal injuries and minor trauma in space: incidence and injury mechanisms in U.S. astronauts. , 2009, Aviation, space, and environmental medicine.

[34]  K Henriksen,et al.  Using Probabilistic Risk Assessment to Model Medication System Failures in Long-term Care Facilities -- Advances in Patient Safety: From Research to Implementation (Volume 2: Concepts and Methodology) , 2005 .