Investigating the Perceived Precision and validity of a Field-Deployable Machine Learning-based Tool to Detect Post-Traumatic Stress Disorder (PTSD) Hyperarousal Events

Post Traumatic Stress Disorder is a psychiatric condition experienced by individuals after exposure to a traumatic event. Prior work has shown promise in detecting PTSD using physiological data such as heart rate. Despite the promise shown by the machine learning based algorithms for PTSD, the validation approaches used in previous research largely rely on theoretical and computational validation methods rather than naturalistic evaluations that account for users perceived precision and validity. Previous research has shown that users perceptions of physiological changes may not always align well with automated detection of such variables and such misalignment may lead to distrust in automated detection which may affect adoption or sustainable usage of such technologies. Therefore, the goal of this article is to investigate the perceived precision of the PTSD hyperarousal detection tool (developed previously) in a home study with a group of PTSD patients. Naturalistic evaluation of such data driven algorithms may provide foundational insight into the efficacy of such tools for non intrusive and cost efficient remote monitoring of PTSD symptoms and will pave the way for their future adoption and sustainable use. The results showed over sixty five percent of perceived precision in naturalistic validation of the detection tool. Further, the results indicated that longitudinal exposure to the detection tool might calibrate users trust in automation.

[1]  R. Pietrzak,et al.  PTSD and obesity in U.S. military veterans: Prevalence, health burden, and suicidality. , 2020, Psychiatry Research.

[2]  K. Qaraqe,et al.  Diabetes Management Experience and the State of Hypoglycemia: National Online Survey Study , 2020, JMIR diabetes.

[3]  David M. Diamond,et al.  Current status on behavioral and biological markers of PTSD: A search for clarity in a conflicting literature , 2013, Neuroscience & Biobehavioral Reviews.

[4]  Anthony D. McDonald,et al.  Understanding Heart Rate Reactions to Posttraumatic Stress Disorder (PTSD) Among Veterans , 2020 .

[5]  S. Woody,et al.  Suffocation false alarms and efficacy of cognitive behavioral therapy for panic disorder , 1996 .

[6]  Anthony D. McDonald,et al.  Understanding Heart Rate Reactions to Post-Traumatic Stress Disorder (PTSD) Among Veterans: A Naturalistic Study , 2021, Hum. Factors.

[7]  Oge Marques Machine Learning with Core ML , 2020 .

[8]  Ryan D. Edwards,et al.  Medical costs of war in 2035: long-term care challenges for veterans of Iraq and Afghanistan. , 2012, Military medicine.

[9]  Nina A. Sayer,et al.  Prevalence, Assessment, and Treatment of Mild Traumatic Brain Injury and Posttraumatic Stress Disorder: A Systematic Review of the Evidence , 2011, The Journal of head trauma rehabilitation.

[10]  Özgür Sahin Introduction to Apple ML Tools , 2021 .

[11]  D. Dawson,et al.  The efficacy of objective and subjective predictors of driving performance during sleep restriction and circadian misalignment. , 2017, Accident; analysis and prevention.

[12]  Arjun H. Rao,et al.  Continuous monitoring and detection of post-traumatic stress disorder (PTSD) triggers among veterans: A supervised machine learning approach , 2019, IISE Transactions on Healthcare Systems Engineering.

[13]  Anthony D. McDonald,et al.  Toward a Taxonomy for Analyzing the Heart Rate as a Physiological Indicator of Posttraumatic Stress Disorder: Systematic Review and Development of a Framework , 2020, JMIR mental health.

[14]  H. Resnick,et al.  National estimates of exposure to traumatic events and PTSD prevalence using DSM-IV and DSM-5 criteria. , 2013, Journal of traumatic stress.

[15]  Nehemiah T. Liu,et al.  Machine Learning for Predicting Outcomes in Trauma , 2017, Shock.

[16]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[17]  Michael E. Labhard,et al.  Mobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness , 2010, Journal of medical Internet research.

[18]  Assessing the Development of Operator Trust in Automation: A Longitudinal Study of an Autonomous Campus Shuttle , 2020 .

[19]  Olga V. Demler,et al.  Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[20]  Anthony J. Ries,et al.  Calibrating Trust in Automation Through Familiarity With the Autoparking Feature of a Tesla Model X , 2019, Journal of Cognitive Engineering and Decision Making.

[21]  Xuan Truong Tran Applying computer vision for detection of diseases in plants , 2019 .

[22]  D. Fowles Motivational Approach to Anxiety Disorders , 2019, Anxiety: Recent Developments in Cognitive, Psychophysiological, and Health Research.

[23]  Anthony D. McDonald,et al.  Analyzing Heart Rate as a Physiological Indicator of Post-Traumatic Stress Disorder: A Scoping Literature Review , 2019, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[24]  F. Scheer,et al.  Daily circadian misalignment impairs human cognitive performance task-dependently , 2018, Scientific Reports.

[25]  Anthony D. McDonald,et al.  Investigating Heart Rate Patterns During Hyperarousal Events Among Veterans Who Have Posttraumatic Stress Disorder (PTSD) , 2021 .

[26]  C. Aliferis,et al.  Machine learning methods to predict child posttraumatic stress: a proof of concept study , 2017, BMC Psychiatry.

[27]  Anthony D. McDonald,et al.  Posttraumatic stress disorder hyperarousal event detection using smartwatch physiological and activity data , 2021, PloS one.

[28]  A. Statnikov,et al.  Quantitative forecasting of PTSD from early trauma responses: a Machine Learning application. , 2014, Journal of psychiatric research.

[29]  A. Statnikov,et al.  Utilization of machine learning for prediction of post-traumatic stress: a re-examination of cortisol in the prediction and pathways to non-remitting PTSD , 2017, Translational Psychiatry.