Wearable Biomedical Measurement Systems for Assessment of Mental Stress of Combatants in Real Time

The Spanish Ministry of Defense, through its Future Combatant program, has sought to develop technology aids with the aim of extending combatants' operational capabilities. Within this framework the ATREC project funded by the “Coincidente” program aims at analyzing diverse biometrics to assess by real time monitoring the stress levels of combatants. This project combines multidisciplinary disciplines and fields, including wearable instrumentation, textile technology, signal processing, pattern recognition and psychological analysis of the obtained information. In this work the ATREC project is described, including the different execution phases, the wearable biomedical measurement systems, the experimental setup, the biomedical signal analysis and speech processing performed. The preliminary results obtained from the data analysis collected during the first phase of the project are presented, indicating the good classification performance exhibited when using features obtained from electrocardiographic recordings and electrical bioimpedance measurements from the thorax. These results suggest that cardiac and respiration activity offer better biomarkers for assessment of stress than speech, galvanic skin response or skin temperature when recorded with wearable biomedical measurement systems.

[1]  Shaomei Wu,et al.  Exploring the use of physiology in adaptive game design , 2011, 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet).

[2]  Jens Muehlsteff,et al.  Medical application and clinical validation for reliable and trustworthy physiological monitoring using functional textiles: Experience from the HeartCycle and MyHeart project , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Martin Ouwerkerk,et al.  Unobtrusive Emotions Sensing in Daily Life , 2010 .

[4]  Rosalind W. Picard.  The Galvactivator: A glove that senses and communicates skin conductivity , 2001 .

[5]  Herbert Reichl,et al.  Fully untegrated EKG shirt based on embroidered electrical interconnections with conductive yarn and miniaturized flexible electronics , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[6]  Gonzalo Bailador,et al.  A Stress-Detection System Based on Physiological Signals and Fuzzy Logic , 2011, IEEE Transactions on Industrial Electronics.

[7]  Léon J. M. Rothkrantz,et al.  Voice Stress Analysis , 2004, TSD.

[8]  Kimmy Ansems,et al.  Smart Photo Frame for Arousal Feedback - Wearable sensors and intelligent healthy work environment , 2011, Intelligent Environments.

[9]  Edward Grant,et al.  Fabric-Based Active Electrode Design and Fabrication for Health Monitoring Clothing , 2009, IEEE Transactions on Information Technology in Biomedicine.

[10]  Fernando Seoane,et al.  Sensorized Garments and Textrode-Enabled Measurement Instrumentation for Ambulatory Assessment of the Autonomic Nervous System Response in the ATREC Project , 2013, Sensors.

[11]  Jean-Yves Fourniols,et al.  Smart wearable systems: Current status and future challenges , 2012, Artif. Intell. Medicine.

[12]  Emil Jovanov,et al.  Stress monitoring using a distributed wireless intelligent sensor system. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[13]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[14]  Wei Chen,et al.  Smart Jacket Design for Neonatal Monitoring with Wearable Sensors , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[15]  Enzo Pasquale Scilingo,et al.  Towards a smart glove: Arousal recognition based on textile Electrodermal Response , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[16]  Sazali Yaacob,et al.  Automated system for stress evaluation based on EEG signal: A prospective review , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[17]  Fernando Seoane,et al.  An analog front-end enables electrical impedance spectroscopy system on-chip for biomedical applications , 2008, Physiological measurement.

[18]  J. C. Marquez,et al.  Textrode-enabled transthoracic electrical bioimpedance measurements – towards wearable applications of impedance cardiography , 2013 .

[19]  A. Bolz,et al.  Wireless Telecardiological Monitoring System for the Homecare Area , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[20]  Matthias Rauterberg,et al.  Unconscious emotions: quantifying and logging something we are not aware of , 2013, Personal and Ubiquitous Computing.

[21]  Ricardo Gutierrez-Osuna,et al.  Using Heart Rate Monitors to Detect Mental Stress , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[22]  C. Gehin,et al.  Wrist ambulatory monitoring system and smart glove for real time emotional, sensorial and physiological analysis , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Matthew S. Goodwin,et al.  iCalm: Wearable Sensor and Network Architecture for Wirelessly Communicating and Logging Autonomic Activity , 2010, IEEE Transactions on Information Technology in Biomedicine.

[24]  C.C.Y. Poon,et al.  A Health-Shirt using e-Textile Materials for the Continuous and Cuffless Monitoring of Arterial Blood Pressure , 2006, 2006 3rd IEEE/EMBS International Summer School on Medical Devices and Biosensors.

[25]  Christos D. Katsis,et al.  Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Carson Reynolds,et al.  The HandWave Bluetooth Skin Conductance Sensor , 2005, ACII.

[27]  J. Gorman,et al.  Effect of mental stress throughout the day on cardiac autonomic control , 1994, Biological Psychology.

[28]  Georges Delhomme,et al.  Smart clothes for the monitoring in real time and conditions of physiological, emotional and sensorial reactions of human , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[29]  B Comet,et al.  Telemonitoring of vital parameters with newly designed biomedical clothing. , 2004, Studies in health technology and informatics.

[30]  Robert Plutchik,et al.  A Structural Theory of Ego Defenses and Emotions , 1979 .

[31]  Enzo Pasquale Scilingo,et al.  A Multimodal Transducer for Cardiopulmonary Activity Monitoring in Emergency , 2010, IEEE Transactions on Information Technology in Biomedicine.

[32]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[33]  P. Grossman.  The LifeShirt: a multi-function ambulatory system monitoring health, disease, and medical intervention in the real world. , 2004, Studies in health technology and informatics.

[34]  Rosalind W. Picard.  Future affective technology for autism and emotion communication , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[35]  Masashi Yasuda,et al.  Development of a skin temperature measuring system for non-contact stress evaluation , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[36]  John H. L. Hansen,et al.  Robust Emotional Stressed Speech Detection Using Weighted Frequency Subbands , 2011, EURASIP J. Adv. Signal Process..

[37]  Rita Paradiso,et al.  WEALTHY – a wearable healthcare system: new frontier on e-textile , 2005, Journal of Telecommunications and Information Technology.

[38]  Michel Besserve,et al.  Multimodal information improves the rapid detection of mental fatigue , 2013, Biomed. Signal Process. Control..

[39]  Neerincx,et al.  Geo-collaboration under stress , 2007 .

[40]  Begoña García Zapirain,et al.  A Stress Sensor Based on Galvanic Skin Response (GSR) Controlled by ZigBee , 2012, Sensors.

[41]  M. Lorr,et al.  Manual for the Profile of Mood States , 1971 .

[42]  Chao Li,et al.  Realization of stress detection using psychophysiological signals for improvement of human-computer interactions , 2005, Proceedings. IEEE SoutheastCon, 2005..

[43]  J. C. Marquez,et al.  Textrode functional straps for bioimpedance measurements-experimental results for body composition analysis , 2013, European Journal of Clinical Nutrition.

[44]  Enzo Pasquale Scilingo,et al.  ELECTROACTIVE FABRICS AND WEARABLE BIOMONITORING DEVICES , 2003, AUTEX Research Journal.

[45]  Lei Wang,et al.  A wearable respiratory biofeedback system based on generalized body sensor network. , 2011, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[46]  Maria Romano,et al.  An ultra-high input impedance ECG amplifier for long-term monitoring of athletes , 2010, Medical devices.

[47]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[48]  Fernando Seoane,et al.  Bioimpedance-Based Wearable Measurement Instrumentation for Studying the Autonomic Nerve System Response to Stressful Working Conditions , 2013 .

[49]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[50]  Fernando Seoane,et al.  Comparison of dry-textile electrodes for electrical bioimpedance spectroscopy measurements , 2010 .

[51]  P. Sleight,et al.  Effects of controlled breathing, mental activity and mental stress with or without verbalization on heart rate variability. , 2000, Journal of the American College of Cardiology.

[52]  Geert-Jan M. Kruijff,et al.  Analysis of Speech Under Stress and Cognitive Load in USAR Operations , 2014, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[53]  Seulki Lee,et al.  A Wearable ECG Acquisition System With Compact Planar-Fashionable Circuit Board-Based Shirt , 2009, IEEE Transactions on Information Technology in Biomedicine.

[54]  P. Castiglioni,et al.  MagIC: a Textile System for Vital Signs Monitoring. Advancement in Design and Embedded Intelligence for Daily Life Applications , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  Rosalind W. Picard,et al.  A Wearable Sensor for Unobtrusive, Long-Term Assessment of Electrodermal Activity , 2010, IEEE Transactions on Biomedical Engineering.