Emotion Recognition System using Pulse Plethysmograph

Emotion recognition is significant for the advancement and development of modern technology. Existing methods currently in use are less accurate, expensive, and complicated. This system is based on Pulse Plethysmograph (PuPG) signal analysis and brings novelty in the emotion recognition system. In this study, 594 PuPG signals were acquired from various subjects for five emotions under consideration. Data acquisition was performed by attaching the PuPG sensor to the subject's index finger. Raw PuPG signals were preprocessed to remove the noisy components. Then, after comprehensive features analysis, twenty-two features possessing maximum interclass differences were selected to classify emotions under investigation through Ensemble Bagged Trees, K-Nearest Neighbor (KNN), Support Vector Machines (SVM) and Tree classification methods. Ensemble Bagged Trees achieved a maximum average accuracy of90.7% upon extensive experimentation. The proposed methodology is simple, low cost, and accurate as compared to existing methods and provides a new paradigm towards developing emotion recognition systems.

[1]  Mumtaz Begum Mustafa,et al.  Speech emotion recognition research: an analysis of research focus , 2018, International Journal of Speech Technology.

[2]  C. D. De Luca,et al.  Effects of electrode location on myoelectric conduction velocity and median frequency estimates. , 1986, Journal of applied physiology.

[3]  D. Shmilovitz,et al.  On the definition of total harmonic distortion and its effect on measurement interpretation , 2005, IEEE Transactions on Power Delivery.

[4]  B. Noble,et al.  On certain integrals of Lipschitz-Hankel type involving products of bessel functions , 1955, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[5]  Carlos Busso,et al.  Jointly Predicting Arousal, Valence and Dominance with Multi-Task Learning , 2017, INTERSPEECH.

[6]  Goran Martinović,et al.  Emotion Recognition System by a Neural Network Based Facial Expression Analysis , 2013 .

[7]  Christopher Joseph Pal,et al.  EmoNets: Multimodal deep learning approaches for emotion recognition in video , 2015, Journal on Multimodal User Interfaces.

[8]  Ahmad R. Sharafat,et al.  Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals , 2015, Comput. Methods Programs Biomed..

[9]  Yuankai Huo,et al.  Differences in neural activity when processing emotional arousal and valence in autism spectrum disorders , 2016, Human brain mapping.

[10]  Erik Cambria,et al.  Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[11]  Muhammad Umar Khan,et al.  Electromyography (EMG) Data-Driven Load Classification using Empirical Mode Decomposition and Feature Analysis , 2019, 2019 International Conference on Frontiers of Information Technology (FIT).

[12]  Fabien Ringeval,et al.  AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge , 2016, AVEC@ACM Multimedia.

[13]  Kai Keng Ang,et al.  EEG-based Emotion Recognition Using Self-Organizing Map for Boundary Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[14]  Muhammad Umar Khan,et al.  Characterization of Term and Preterm Deliveries using Electrohysterograms Signatures , 2019, 2019 IEEE 10th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[15]  Muhammad Umar Khan,et al.  Classification of EMG Signals for Assessment of Neuromuscular Disorder using Empirical Mode Decomposition and Logistic Regression , 2019, 2019 International Conference on Applied and Engineering Mathematics (ICAEM).

[16]  Thomas G. Dietterich An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[17]  Jesse Hoey,et al.  EmotiW 2016: video and group-level emotion recognition challenges , 2016, ICMI.

[18]  M. Deriche,et al.  A Bilingual Emotion Recognition System Using Deep Learning Neural Networks , 2018, 2018 15th International Multi-Conference on Systems, Signals & Devices (SSD).

[19]  Karl J. Friston,et al.  Variance Components , 2003 .

[20]  Fadel Adib,et al.  Emotion recognition using wireless signals , 2016, MobiCom.

[21]  Seyedmahdad Mirsamadi,et al.  Automatic speech emotion recognition using recurrent neural networks with local attention , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Javad Frounchi,et al.  Wavelet-based emotion recognition system using EEG signal , 2017, Neural Computing and Applications.

[23]  Muhammad Umar Khan,et al.  ECG-based Biometric Authentication using Empirical Mode Decomposition and Support Vector Machines , 2019, 2019 IEEE 10th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[24]  Richard A. Groeneveld,et al.  Measuring Skewness and Kurtosis , 1984 .

[25]  M. Mather,et al.  Arousal (but not valence) amplifies the impact of salience , 2017, Cognition & emotion.