Mental Stress Detection Using Multimodal Sensing in a Wireless Body Area Network

This thesis presents the design and implementation of a software framework that allows to collect and store physiological data on small sensor devices attached to a human being (forming a Wireless Body Area Network). It describes how sensor data from two biosensors (GSR and ECG) is collected in a number of field experiments, where subjects are exposed to different emotional situations. The experiments are done together with a group of researchers from the department of psychology at Freie Universitat Berlin, FUB. The collected data is then used to (post factum) extract a set of features, which are used as input for existing machine learning algorithms to study how mental stress of human beings can be detected automatically. The evaluation of the algorithms shows that multimodal sensing can improve the stress detection accuracy.

[1]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[2]  Philip Levis,et al.  TinyOS Programming: Introduction , 2009 .

[3]  Ying Gao,et al.  A digital signal processing approach for affective sensing of a computer user through pupil diameter monitoring , 2009 .

[4]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[5]  David G. Stork,et al.  Pattern Classification , 1973 .

[6]  Jennifer Healey,et al.  Out of the Lab and into the Fray: Towards Modeling Emotion in Everyday Life , 2010, Pervasive.

[7]  Adrian Burns,et al.  SHIMMER™ – A Wireless Sensor Platform for Noninvasive Biomedical Research , 2010, IEEE Sensors Journal.

[8]  A. K. Blangsted,et al.  The effect of mental stress on heart rate variability and blood pressure during computer work , 2004, European Journal of Applied Physiology.

[9]  Omar AlZoubi,et al.  Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor , 2011, AIED.

[10]  M. Bradley,et al.  Probing picture perception: activation and emotion. , 1996, Psychophysiology.

[11]  G. Becher,et al.  Medical Sensors of the BASUMA Body Sensor Network , 2007, BSN.

[12]  Ingrid Moerman,et al.  A survey on wireless body area networks , 2011, Wirel. Networks.

[13]  Jyh-Horng Chen,et al.  Study of Human Affective Response on Multimedia Contents , 2007 .

[14]  Martin L. Griss,et al.  Activity-Aware Mental Stress Detection Using Physiological Sensors , 2010, MobiCASE.