Assessment of Mental, Emotional and Physical Stress through Analysis of Physiological Signals Using Smartphones

Determining the stress level of a subject in real time could be of special interest in certain professional activities to allow the monitoring of soldiers, pilots, emergency personnel and other professionals responsible for human lives. Assessment of current mental fitness for executing a task at hand might avoid unnecessary risks. To obtain this knowledge, two physiological measurements were recorded in this work using customized non-invasive wearable instrumentation that measures electrocardiogram (ECG) and thoracic electrical bioimpedance (TEB) signals. The relevant information from each measurement is extracted via evaluation of a reduced set of selected features. These features are primarily obtained from filtered and processed versions of the raw time measurements with calculations of certain statistical and descriptive parameters. Selection of the reduced set of features was performed using genetic algorithms, thus constraining the computational cost of the real-time implementation. Different classification approaches have been studied, but neural networks were chosen for this investigation because they represent a good tradeoff between the intelligence of the solution and computational complexity. Three different application scenarios were considered. In the first scenario, the proposed system is capable of distinguishing among different types of activity with a 21.2% probability error, for activities coded as neutral, emotional, mental and physical. In the second scenario, the proposed solution distinguishes among the three different emotional states of neutral, sadness and disgust, with a probability error of 4.8%. In the third scenario, the system is able to distinguish between low mental load and mental overload with a probability error of 32.3%. The computational cost was calculated, and the solution was implemented in commercially available Android-based smartphones. The results indicate that execution of such a monitoring solution is negligible compared to the nominal computational load of current smartphones.

[1]  John A Updegraff,et al.  Biobehavioral responses to stress in females: tend-and-befriend, not fight-or-flight. , 2000, Psychological review.

[2]  G. Billman The LF/HF ratio does not accurately measure cardiac sympatho-vagal balance , 2013, Front. Physio..

[3]  R. Gil-Pita,et al.  Detection of Emotions and Stress through Speech Analysis , 2013 .

[4]  Cyrus Martin,et al.  What is stress? , 2014, Current Biology.

[5]  D. Carroll,et al.  Heart rate and oxygen consumption during mental arithmetic, a video game, and graded static exercise. , 1987, Psychophysiology.

[6]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[7]  Harald Merckelbach,et al.  Dissociation, memory commission errors, and heightened autonomic reactivity , 2007, Psychiatry Research.

[8]  L. McEvoy,et al.  Mental Effort‐Related EEG Modulation During Video‐Game Play: Comparison Between Juvenile Subjects with Epilepsy and Normal Control Subjects , 1999, Epilepsia.

[9]  Martin T. Hagan,et al.  Neural network design , 1995 .

[10]  Fernando Seoane,et al.  Wearable Biomedical Measurement Systems for Assessment of Mental Stress of Combatants in Real Time , 2014, Sensors.

[11]  D. Fotiadis,et al.  An integrated telemedicine platform for the assessment of affective physiological states , 2006, Diagnostic pathology.

[12]  G. Sheblé,et al.  Genetic algorithm solution of economic dispatch with valve point loading , 1993 .

[13]  V Marigliano,et al.  Power spectral analysis of heart rate variability in obese subjects: evidence of decreased cardiac sympathetic responsiveness. , 1996, International journal of obesity and related metabolic disorders : journal of the International Association for the Study of Obesity.

[14]  Dimitrios Hatzinakos,et al.  ECG Pattern Analysis for Emotion Detection , 2012, IEEE Transactions on Affective Computing.

[15]  P. Perruchet,et al.  The effect of attentional load on the breathing pattern in children. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  Lance D. Chambers,et al.  Practical Handbook of Genetic Algorithms , 1995 .

[17]  Michel Besserve,et al.  Multimodal information improves the rapid detection of mental fatigue , 2013, Biomed. Signal Process. Control..

[18]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[19]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .

[20]  R. Mccraty,et al.  The effects of emotions on short-term power spectrum analysis of heart rate variability . , 1995, The American journal of cardiology.

[21]  Mathias Clasen,et al.  Vampire Apocalypse: A Biocultural Critique of Richard Matheson's I Am Legend , 2010 .

[22]  Fumitaka Kimura,et al.  Recognition of Off-Line Handwritten Devnagari Characters Using Quadratic Classifier , 2006, ICVGIP.

[23]  Tom Brown America First: Naming the Nation in US Film , 2008 .

[24]  Adriano Piccardi American History X , 1999 .

[25]  S. Yoo,et al.  Using Neural Network to Recognize Human Emotions from Heart Rate Variability and Skin Resistance , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[26]  R A Waugh,et al.  Effects of mental stress on myocardial ischemia during daily life. , 1997, JAMA.

[27]  Ricardo Gutierrez-Osuna,et al.  Using Heart Rate Monitors to Detect Mental Stress , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[28]  Cristina Fernández Megías,et al.  Validación española de una batería de películas para inducir emociones , 2011 .

[29]  G. Zajicek,et al.  The Wisdom of the Body , 1934, Nature.

[30]  Chang Wook Ahn,et al.  On the practical genetic algorithms , 2005, GECCO '05.

[31]  A. Loewy,et al.  Central Command Neurons of the Sympathetic Nervous System: Basis of the Fight-or-Flight Response , 1995, Science.

[32]  H. Merckelbach,et al.  Dissociative experiences are related to commissions in emotional memory. , 2003, Behaviour research and therapy.

[33]  Gregory S. Kolt,et al.  Eustress, distress, and interpretation in occupational stress , 2003 .

[34]  Alireza Mehrnia,et al.  On optimal IFIR filter design , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[35]  D. Carroll,et al.  Heart rate and oxygen consumption during mental arithmetic, a video game, and graded exercise: further evidence of metabolically-exaggerated cardiac adjustments? , 1985, Psychophysiology.

[36]  Neil Jackson Cannibal Holocaust, Realist Horror, and Reflexivity , 2002 .

[37]  Silverthorn Dee Unglaub Human Physiology: An Integrated Approach , 1998 .

[38]  Marko Grobelnik,et al.  Feature selection using linear classifier weights: interaction with classification models , 2004, SIGIR '04.

[39]  J. Gorman,et al.  Effect of mental stress throughout the day on cardiac autonomic control , 1994, Biological Psychology.

[40]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[41]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.