Integrating Big Data analytics, virtual reality, and ARAIG to support resilience assessment and development in tactical training

Combat tactical training activities utilising virtual reality environments are being used increasingly to create training scenarios to promote resilience against stressors and to enable standardized training scenarios to allow trainees to learn techniques for various stressors. Resilience is an important component for mental health. However, assessment of the trainees' response to these training activities has either been limited to various pre and post training assessment metrics or collected in parallel during experiments and analysed after collection rather than in real-time. New Big Data approaches have the potential to provide real-time analytics. We have created a Big Data analytics platform, Athena, that in real-time acquires data from a first person shooter military combat simulation game, ArmA 3, as well as the data ArmA 3 sends to the muscle stimulation component of a multisensory garment, ARAIG that provides on the body feedback to the wearer for communications, weapon fire and being hit and integrates that data with physiological response data such as heart rate, breathing behaviour and blood oxygen saturation. We present results from our initial pilot study from an ethics approved equipment integration study. Our approach is equally applicable for Virtual Reality Graded Exposure Therapy with physiological monitoring.

[1]  Carolyn McGregor,et al.  Next Generation Neonatal Health Informatics with Artemis , 2011, MIE.

[2]  Robert Stewart,et al.  Resilience and mental health. , 2010, Clinical psychology review.

[3]  Brodie Stanfield,et al.  Design of the ARAIG haptic garment for enhanced resilience assessment and development in tactical training serious games , 2016, 2016 IEEE 6th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[4]  Dennis Patrick Wood,et al.  Combat-related post-traumatic stress disorder: a case report using virtual reality graded exposure therapy with physiological monitoring with a female Seabee. , 2009, Military medicine.

[5]  Brenda K. Wiederhold,et al.  Virtual reality and other experiential therapies for combat-related posttraumatic stress disorder , 2006 .

[6]  J. Thayer,et al.  Heart rate variability and its relation to prefrontal cognitive function: the effects of training and detraining , 2004, European Journal of Applied Physiology.

[7]  Carolyn McGregor,et al.  A Rule-Based Temporal Analysis Method for Online Health Analytics and Its Application for Real-Time Detection of Neonatal Spells , 2014, 2014 IEEE International Congress on Big Data.

[8]  Albert Rizzo,et al.  Virtual Reality as a Tool for Delivering PTSD Exposure Therapy and Stress Resilience Training , 2013 .

[9]  Brodie Stanfield,et al.  A Method for Real-Time Stimulation and Response Monitoring Using Big Data and Its Application to Tactical Training , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[10]  Carolyn McGregor,et al.  Big Data Analytics for Resilience Assessment and Development in Tactical Training Serious Games , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[11]  Julie Salcedo,et al.  Squad Overmatch: Using Virtual Technology to Enhance Live Training Environments , 2015, HCI.

[12]  Carolyn McGregor,et al.  Late onset neonatal sepsis detection in newborn infants via multiple physiological streams , 2013 .

[13]  Carolyn McGregor,et al.  Variability analysis with analytics applied to physiological data streams from the neonatal intensive care unit , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).