Human emotion classification based on multiple physiological signals by wearable system

BACKGROUND: Human emotion classification is traditionally achieved using multi-channel electroencephalogram (EEG) signal, which requires costly equipment and complex classification algorithms. OBJECTIVE: The experiments can be implemented in the laboratory environment equipped with high-performance computers for the online analysis; this will hinder the usability in practical applications. METHODS: Considering that other physiological signals are also associated with emotional changes, this paper proposes to use a wearable, wireless system to acquire a single-channel electroencephalogram signal, respiration, electrocardiogram (ECG) signal, and body postures to explore the relationship between these signals and the human emotions. RESULTS AND CONCLUSIONS: Compared with traditional emotion classification method, the presented method was able to extract a small number of key features associated with human emotions from multiple physiological signals, where the algorithm complexity was greatly reduced when incorporated with the support vector machine classification. The proposed method can support an embedded on-line analysis and may enhance the usability of emotion classification.

[1]  Andrea Petracca,et al.  A real-time classification algorithm for EEG-based BCI driven by self-induced emotions , 2015, Comput. Methods Programs Biomed..

[2]  Ishwar K. Sethi,et al.  Investigation of combining SVM and decision tree for emotion classification , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[3]  Dimitrios Hatzinakos,et al.  ECG Pattern Analysis for Emotion Detection , 2012, IEEE Transactions on Affective Computing.

[4]  Bao-Liang Lu,et al.  Emotion classification based on gamma-band EEG , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Mohamed Rizon.  Discrete Wavelet Transform Based Classification of Human Emotions Using Electroencephalogram Signals , 2010 .

[6]  Won-Hyung Lee,et al.  A Study on Emotion Classification utilizing Bio-Signal (PPG, GSR, RESP) , 2015 .

[7]  Yaacob Sazali,et al.  Classification of human emotion from EEG using discrete wavelet transform , 2010 .

[8]  Thierry Dutoit,et al.  Automatic Processing of EEG-EOG-EMG Artifacts in Sleep Stage Classification , 2009 .

[9]  J. Genest,et al.  Posture- and emotion-induced severe hypertensive paroxysms with baroreceptor dysfunction. , 1987, Journal of hypertension.

[10]  Qing Ruan,et al.  Hilbert-Huang Transform (HHT) Analysis of Human Activities Using Through-Wall Noise Radar , 2007, 2007 International Symposium on Signals, Systems and Electronics.

[11]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[12]  R. Ólafsson,et al.  Emotion regulation in pathological skin picking: findings from a non-treatment seeking sample. , 2010, Journal of behavior therapy and experimental psychiatry.

[13]  K. Scherer,et al.  Emotion expression in body action and posture. , 2012, Emotion.

[14]  H. Prendinger,et al.  Emotion Recognition from Electromyography and Skin Conductance , 2005 .

[15]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[16]  Han Wen Guo,et al.  Short-term analysis of heart rate variability for emotion recognition via a wearable ECG device , 2015, 2015 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS).

[17]  S. A. Hosseini,et al.  Emotion recognition method using entropy analysis of EEG signals , 2011 .

[18]  Pei-Chen Lo,et al.  Adaptive Baseline Correction of Meditation EEG , 2001 .

[19]  Bao-Liang Lu,et al.  Differential entropy feature for EEG-based emotion classification , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[20]  Fei Xie,et al.  A wearable health monitoring system with multi-parameters , 2013, 2013 6th International Conference on Biomedical Engineering and Informatics.

[21]  Yue Zhao,et al.  An anti-interference EEG-EOG hybrid detection approach for motor image identification and eye track recognition , 2015, 2015 34th Chinese Control Conference (CCC).

[22]  T. Endrass,et al.  Timing effects of antecedent- and response-focused emotion regulation strategies , 2013, Biological Psychology.

[23]  Yi-Hsuan Yang,et al.  Music Emotion Classification: A Regression Approach , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[24]  Abhishek Vaish,et al.  A Comparative Study on Machine Learning Algorithms in Emotion State Recognition Using ECG , 2012, SocProS.

[25]  Chen Fan,et al.  Gesture detection and data fusion based on MPU9250 sensor , 2015, 2015 12th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[26]  H. Witte,et al.  New spectral detection and elimination test algorithms of ECG and EOG artefacts in neonatal EEG recordings , 2006, Medical and Biological Engineering and Computing.

[27]  Dan Liu,et al.  A multifunctional wireless body area sensors network with real time embedded data analysis , 2016, 2016 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[28]  Emmanuel Dellandréa,et al.  Deep learning vs. kernel methods: Performance for emotion prediction in videos , 2015, ACII.

[29]  Dan Liu,et al.  Driving Fatigue Detection Based on EEG Signal , 2015, 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC).

[30]  Jing Cai,et al.  The Research on Emotion Recognition from ECG Signal , 2009, 2009 International Conference on Information Technology and Computer Science.

[31]  N. Thakor,et al.  Removal of ECG interference from the EEG recordings in small animals using independent component analysis , 2001, Journal of Neuroscience Methods.