Modeling observer stress: A computational approach

Stress is a major problem in our society today and poses major concerns for the future. It is important to gain an objective understanding of how average individuals respond to events they observe in typical environments they encounter. We developed a computational model of stress based on objective human responses collected from human observers of environments. In the process, we investigated whether a computational model can be developed to recognize observer stress in abstract virtual environments text, virtual environments films and real environments real-life settings using physiological and physical response sensor signals. Our work proposes an architecture for a computational observer stress model. The architecture was used it to implement models for the different types of environments. Sensors appropriate to the different types of environment were investigated where the aims were to achieve unobtrusive methods for stress response signal collection, reduce encumbrance and hence, enhance methods to capture natural observer behaviors and produce stress models that recognized stress more robustly. We discuss the motivations for each investigation and detail the experiments we conducted to collect stress data sets for observers of the different types of environments. We describe individual-independent artificial neural network and support vector machine based model classifiers that were developed to recognize stress patterns from observer response signals. The classifiers were extended to include a genetic algorithm which was used to select features that were better for stress recognition and reduce the use of redundant features. The outcomes of this research provide a possible future extension on managing stress objectively.

[1]  Armando Barreto,et al.  Non-intrusive Physiological Monitoring for Automated Stress Detection in Human-Computer Interaction , 2007, ICCV-HCI.

[2]  H Selye,et al.  The Stress Syndrome , 1965, [Kango gijutsu] : [Nursing technique].

[3]  Sung-Nien Yu,et al.  Conditional mutual information-based feature selection for congestive heart failure recognition using heart rate variability , 2012, Comput. Methods Programs Biomed..

[4]  Jyrki Rasku,et al.  Prediction of a state of a subject on the basis of a stabilogram signal and video oculography test , 2012, Comput. Methods Programs Biomed..

[5]  Gonzalo Bailador,et al.  Two Stress Detection Schemes Based on Physiological Signals for Real-Time Applications , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[6]  D. Hennessy,et al.  Traffic congestion, driver stress, and driver aggression , 1999 .

[7]  L. Pearlin,et al.  Current Issues and Future Directions in Research into the Stress Process , 2013 .

[8]  Sung-Nien Yu,et al.  Selection of Heart Rate Variability Features for Congestive Heart Failure Recognition Using Support Vector Machine-Based Criteria , 2011 .

[9]  L Hoffman-Goetz,et al.  Exercise and the immune system: a model of the stress response? , 1994, Immunology today.

[10]  L. R. John,et al.  Quantifying Mental Relaxation with EEG for use in Computer Games , 2006, International Conference on Internet Computing.

[11]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[12]  Fernando De la Torre,et al.  Optimal feature selection for support vector machines , 2010, Pattern Recognit..

[13]  Jennifer Healey,et al.  SmartCar: detecting driver stress , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Ying Gao,et al.  Pupil diameter measurements: untapped potential to enhance computer interaction for eye tracker users? , 2008, Assets '08.

[15]  A. H. Roscoe Assessing pilot workload. Why measure heart rate, HRV and respiration? , 1992, Biological Psychology.

[16]  A Sali,et al.  Mind‐Body Medicine: Stress and Its Impact on Overall Health and Longevity , 2005, Annals of the New York Academy of Sciences.

[17]  W. S. Peavler,et al.  Pupil size, information overload, and performance differences. , 1974, Psychophysiology.

[18]  Mark A. Richardson,et al.  Emotional & physical stress detection and classification using thermal imaging technique , 2009, ICDP.

[19]  Siyuan Chen,et al.  Automatic classification of eye activity for cognitive load measurement with emotion interference , 2013, Comput. Methods Programs Biomed..

[20]  Armando Barreto,et al.  Stress Recognition Using Non-invasive Technology , 2006, FLAIRS.

[21]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[22]  Leonardo Trujillo,et al.  Visual learning of texture descriptors for facial expression recognition in thermal imagery , 2007, Comput. Vis. Image Underst..

[23]  Leonardo Trujillo,et al.  Automatic Feature Localization in Thermal Images for Facial Expression Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[24]  A. Barreto,et al.  Stress Detection in Computer Users Based on Digital Signal Processing of Noninvasive Physiological Variables , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  B. Hjorth EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[26]  Reza Rostami,et al.  Classifying depression patients and normal subjects using machine learning techniques , 2011, 2011 19th Iranian Conference on Electrical Engineering.

[27]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[28]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  J. Sexton,et al.  Error, stress, and teamwork in medicine and aviation: cross sectional surveys , 2000, BMJ : British Medical Journal.

[30]  Vitomir Struc,et al.  Gabor-Based Kernel Partial-Least-Squares Discrimination Features for Face Recognition , 2009, Informatica.

[31]  Yoshio Nakamura,et al.  Heart rate variability, trait anxiety, and perceived stress among physically fit men and women. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[32]  Tao Lin,et al.  Do physiological data relate to traditional usability indexes? , 2005, OZCHI.

[33]  Qiang Chen,et al.  Research on genetic algorithm based on emotion recognition using physiological signals , 2011, 2011 International Conference on Computational Problem-Solving (ICCP).

[34]  Mingtian Zhou,et al.  Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes , 2011, Expert Syst. Appl..

[35]  Zhiwei Zhu,et al.  A Real-Time Human Stress Monitoring System Using Dynamic Bayesian Network , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[36]  Thomas Philip Runarsson,et al.  Test-retest reliability and feature selection in physiological time series classification , 2012, Comput. Methods Programs Biomed..

[37]  Matthias Weippert,et al.  Fuzzy Evaluation of Heart Rate Signals for Mental Stress Assessment , 2007, IEEE Transactions on Fuzzy Systems.

[38]  Howard Poizner,et al.  Detecting Neural Decision Patterns Using SVM-Based EEG Classification , 2010, 2010 4th International Conference on Bioinformatics and Biomedical Engineering.

[39]  Vitomir Struc,et al.  The Complete Gabor-Fisher Classifier for Robust Face Recognition , 2010, EURASIP J. Adv. Signal Process..

[40]  M. J. Katz,et al.  Fractals and the analysis of waveforms. , 1988, Computers in biology and medicine.

[41]  H. Ashton,et al.  A method for measuring human behavioural and physiological responses at different stress levels in a driving simulator , 1972, British journal of pharmacology.

[42]  C. Kirschbaum,et al.  Chronic psychological stress and the regulation of pro-inflammatory cytokines: a glucocorticoid-resistance model. , 2002, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[43]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[44]  J E Schwartz,et al.  Environmental influences on blood pressure and the role of job strain. , 1996, Journal of hypertension. Supplement : official journal of the International Society of Hypertension.

[45]  S.-H Kim,et al.  Feature selection on multi-physiological signals for emotion recognition , 2012, 2011 2nd International Conference on Engineering and Industries (ICEI).

[46]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[47]  Tamás D. Gedeon,et al.  Objective measures, sensors and computational techniques for stress recognition and classification: A survey , 2012, Comput. Methods Programs Biomed..

[48]  Mykola Pechenizkiy,et al.  What's Your Current Stress Level? Detection of Stress Patterns from GSR Sensor Data , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[49]  Jin-Hyuk Hong,et al.  Understanding physiological responses to stressors during physical activity , 2012, UbiComp.

[51]  David Sander,et al.  Thermal Analysis of Facial Muscles Contractions , 2011, IEEE Transactions on Affective Computing.