Stress Recognition Using Non-invasive Technology

The need to provide computers with the ability to estimate the affective state of their users is a major requirement for the practical implementation of Affective Computing concepts. This research aims at sensing and recognizing typical negative emotional states, especially “stress”, when the user is interacting with the computer. An integrated hardware – software setup has been developed to achieve automatic assessment of the affective status of a computer user. A computer-based “Paced Stroop Test” is designed to act as a stimulus to elicit emotional stress in the subject. Four signals: Blood Volume Pulse (BVP), Galvanic Skin Response (GSR), Pupil Diameter (PD) and Skin Temperature (ST) are monitored and analyzed to differentiate affective states in the user. Several signal processing techniques are applied to the signals collected to extract the most relevant features in the physiological responses and feed them into learning systems, to accomplish the affective state classification. Three learning algorithms are applied to this classification process and their performance is compared. Results indicate that the physiological signals monitored do, in fact, have a strong correlation with the changes in emotional state of our experimental subjects.

[1]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[2]  Nilanjan Sarkar,et al.  Affective communication for implicit human-machine interaction , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[3]  K. Quigley,et al.  Applications of Psychophysiological Recording , 2000 .

[4]  Rosalind W. Picard,et al.  Signal processing for recognition of human frustration , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[5]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[6]  Yoshio Nakamura,et al.  Heart rate variability, trait anxiety, and perceived stress among physically fit men and women. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[7]  A. Kistler,et al.  Fingertip temperature as an indicator for sympathetic responses. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[8]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[9]  Eva Hudlicka,et al.  To feel or not to feel: The role of affect in human-computer interaction , 2003, Int. J. Hum. Comput. Stud..

[10]  A. Barreto,et al.  Physiologic Instrumentation for Real-time Monitoring of Affective State of Computer Users , 2003 .

[11]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[12]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[13]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. Blondin,et al.  The stress of Stroop performance: physiological and emotional responses to color-word interference, task pacing, and pacing speed. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  John L. Sibert,et al.  Heart rate variability: indicator of user state as an aid to human-computer interaction , 1998, CHI.

[16]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[17]  H. Selye.  Selye's Guide to Stress Research , 1980 .

[18]  Malek Adjouadi,et al.  Multidimensional Pattern Recognition and Classification of White Blood Cells Using Support Vector Machines , 2005 .

[19]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[20]  J. Stroop.  Studies of interference in serial verbal reactions. , 1992 .

[21]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[22]  K. Hugdahl.  Psychophysiology: The Mind-Body Perspective , 1996 .

[23]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..