Deep learninig of EEG signals for emotion recognition

Emotion recognition is an important task for computer to understand the human status in brain computer interface (BCI) systems. It is difficult to perceive the emotion of some disabled people through their facial expression, such as functional autism patient. EEG signal provides us a non-invasive way to recognize the emotion of these disable people through EEG headset electrodes placed on their scalp. In this paper, we propose a deep learning algorithm to simultaneously learn the features and classify the emotions of EEG signals. It differs from the conventional methods as we apply deep learning on the raw signal without explicit hand-crafted feature extraction. Because the EEG signal has subject dependency, it is better to train the emotion model subject-wise, while there is not much epochs available for each subject. Deep learning algorithm provides a solution with a pre-training way using three layers of restricted Boltzmann machines (RBMs). Thus, we can use epochs of all subjects to pre-training the deep network, and use back-propagation to fine tuning the network subject by subject. Experiment results show that our proposed framework achieves better recognition accuracy than conventional algorithms.

[1]  D. Orlikowski,et al.  A comparison of recording modalities of P300 event-related potentials (ERP) for brain-computer interface (BCI) paradigm , 2013, Neurophysiologie Clinique/Clinical Neurophysiology.

[2]  Johan Hagelbäck,et al.  Evaluating Classifiers for Emotion Recognition Using EEG , 2013, HCI.

[3]  W. De Clercq,et al.  Automatic Removal of Ocular Artifacts in the EEG without an EOG Reference Channel , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[4]  Yu-Ri Lee,et al.  A Novel EEG Feature Extraction Method Using Hjorth Parameter , 2014 .

[5]  Hyo Jong Lee,et al.  Exploration of Prominent Frequency Wave in EEG Signals from Brain Sensors Network , 2015, Int. J. Distributed Sens. Networks.

[6]  Nicole Krämer,et al.  Time Domain Parameters as a feature for EEG-based Brain-Computer Interfaces , 2009, Neural Networks.

[7]  Erich Schröger,et al.  Filter Effects and Filter Artifacts in the Analysis of Electrophysiological Data , 2012, Front. Psychology.

[8]  Mohammad Teshnehlab,et al.  Feature Extraction and Classification of EEG Signals Using Wavelet Transform, SVM and Artificial Neural Networks for Brain Computer Interfaces , 2009, 2009 International Joint Conference on Bioinformatics, Systems Biology and Intelligent Computing.

[9]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[10]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[11]  Andrés Úbeda,et al.  Visual evoked potential-based brain-machine interface applications to assist disabled people , 2012, Expert Syst. Appl..

[12]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[13]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[14]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[15]  V. Mathews,et al.  Assessment and cost comparison of sleep-deprived EEG, MRI and PET in the prediction of surgical treatment for epilepsy , 2002, Seizure.

[16]  Minoru Sasaki,et al.  EEG data classification with several mental tasks , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[17]  M. Kemal Kiymik,et al.  Comparison of STFT and wavelet transform methods in determining epileptic seizure activity in EEG signals for real-time application , 2005, Comput. Biol. Medicine.

[18]  B. Hjorth EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[19]  Hamid Parvin,et al.  MKNN: Modified K-Nearest Neighbor , 2008 .

[20]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[21]  Raja Majid Mehmood,et al.  Alpha Activity during Emotional Experience Revealed by ERSP , 2014 .