Off-line and On-line Stress Detection Through Processing of the Pupil Diameter Signal

The pupil diameter (PD), controlled by the autonomic nervous system, seems to provide a strong indication of affective arousal, as found by previous research, but it has not been investigated fully yet. In this study, new approaches based on monitoring and processing the PD signal for off-line and on-line “relaxation” vs. “stress” differentiation are proposed. For the off-line approach, wavelet denoising, Kalman filtering, data normalization, and feature extraction are sequentially utilized. For the on-line approach, a hard threshold, a moving average window and three stress detection steps are implemented. In order to use only the most reliable data, two types of data selection methods (paired t test based on galvanic skin response (GSR) data and subject self-evaluation) are applied, achieving average classification accuracies up to 86.43 and 87.20% for off-line and 72.30 and 73.55% for on-line algorithms, with each set of selected data, respectively. The GSR was also monitored and processed in our experiments for comparison purposes, with the highest classification rate achieved being only 63.57% (based on the off-line processing algorithm). The overall results show that the PD signal is more effective and robust for differentiating “relaxation” vs. “stress,” in comparison with the traditionally used GSR signal.

[1]  Mobyen Uddin Ahmed,et al.  Using Calibration and Fuzzification of Cases for Improved Diagnosis and Treatment of Stress , 2006 .

[2]  Andrea Bonarini,et al.  The Affective Triad: Stimuli, Questionnaires, and Measurements , 2011, ACII.

[3]  M. Thase,et al.  Pupillary assessment and computational modeling of the Stroop task in depression. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  E. Glover DICTIONARY OF PSYCHOLOGY , 1959 .

[5]  John L. Andreassi,et al.  Psychophysiology: Human Behavior & Physiological Response , 2000 .

[6]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[7]  M. Larsen,et al.  The Psychology of Survey Response , 2002 .

[8]  Martin L. Griss,et al.  Activity-Aware Mental Stress Detection Using Physiological Sensors , 2010, MobiCASE.

[9]  E. Granholm,et al.  Pupillary responses on the visual backward masking task reflect general cognitive ability. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[10]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[11]  Michael A. Arbib,et al.  Who Needs Emotions? - The brain meets the robot , 2004, Who Needs Emotions?.

[12]  A. C. Vindel,et al.  Hiperventilación y experiencia de ansiedad , 2007 .

[13]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[14]  Ying Gao,et al.  Monitoring and Processing of the Pupil Diameter Signal for Affective Assessment of a Computer User , 2009, HCI.

[15]  Fang Chen,et al.  Galvanic skin response (GSR) as an index of cognitive load , 2007, CHI Extended Abstracts.

[16]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[17]  David C. Banks,et al.  Analysis of eye-tracking experiments performed on a Tobii T60 , 2008, Electronic Imaging.

[18]  Shu-Jen Steven Tsai Power Transformer Partial Discharge (PD) Acoustic Signal Detection using Fiber Sensors and Wavelet Analysis, Modeling, and Simulation , 2002 .

[19]  Armando Barreto,et al.  Stress detection in computer users through non-invasive monitoring of physiological signals. , 2006, Biomedical sciences instrumentation.

[20]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[21]  J. Tulen,et al.  Characterization of stress reactions to the Stroop Color Word Test , 1989, Pharmacology Biochemistry and Behavior.

[22]  J. Andreassi Psychophysiology: Human Behavior and Physiological Response , 1980 .

[23]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .

[24]  Ying Gao,et al.  Affective Assessment of a Computer User through the Processing of the Pupil Diameter Signal , 2009, SCSS.

[25]  Frederick H. Martini,et al.  Fundamentals of Anatomy & Physiology , 1989 .

[26]  Scott P. Johnson,et al.  A Critical Test of Temporal and Spatial Accuracy of the Tobii T60XL Eye Tracker. , 2012, Infancy : the official journal of the International Society on Infant Studies.

[27]  Jeff Klingner,et al.  The pupillometric precision of a remote video eye tracker , 2010, ETRA.

[28]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[29]  Alberto de Santos Sierra,et al.  An approach to hand biometrics in mobile devices , 2011, Signal Image Video Process..

[30]  Scott P. Johnson,et al.  ACritical Test of Temporal and Spatial Accuracy of the Tobii T 60 XL Eye Tracker , 2011 .

[31]  P Hjemdahl,et al.  Differentiated sympathetic activation during mental stress evoked by the Stroop test. , 1984, Acta physiologica Scandinavica. Supplementum.

[32]  J. Chaplin Dictionary of psychology , 1975 .

[33]  Peter Funk,et al.  A Case-Based Approach Using Behavioural Biometrics to Determine a User's Stress Level , 2005, ICCBR Workshops.

[34]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[35]  Gonzalo Bailador,et al.  A Stress-Detection System Based on Physiological Signals and Fuzzy Logic , 2011, IEEE Transactions on Industrial Electronics.

[36]  Steven W. Smith,et al.  The Scientist and Engineer's Guide to Digital Signal Processing , 1997 .

[37]  C. Rennie,et al.  Decomposing skin conductance into tonic and phasic components. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[38]  S. Steinhauer,et al.  Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[39]  E. Granholm,et al.  Pupillometric measures of cognitive and emotional processes. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.