Design of Prototype‐Based Emotion Recognizer Using Physiological Signals

This study is related to the acquisition of physiological signals of human emotions and the recognition of human emotions using such physiological signals. To acquire physiological signals, seven emotions are evoked through stimuli. Regarding the induced emotions, the results of skin temperature, photoplethysmography, electrodermal activity, and an electrocardiogram are recorded and analyzed as physiological signals. The suitability and effectiveness of the stimuli are evaluated by the subjects themselves. To address the problem of the emotions not being recognized, we introduce a methodology for a recognizer using prototype-based learning and particle swarm optimization (PSO). The design involves two main phases: i) PSO selects the P% of the patterns to be treated as prototypes of the seven emotions; ii) PSO is instrumental in the formation of the core set of features. The experiments show that a suitable selection of prototypes and a substantial reduction of the feature space can be accomplished, and the recognizer formed in this manner is characterized by high recognition accuracy for the seven emotions using physiological signals.

[1]  Varun Dutt,et al.  Instance-based learning: integrating sampling and repeated decisions from experience. , 2011, Psychological review.

[2]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[3]  Giuseppe Riva,et al.  Trials BioMed Central Study protocol The potential of Virtual Reality as anxiety management tool: a randomized controlled study in a sample of patients affected by Generalized Anxiety Disorder , 2008 .

[4]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  S. Weiss,et al.  Toward a Unifying Definition of Psychological Pain , 2011 .

[6]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[7]  C. Maaoui,et al.  Emotion Recognition through Physiological Signals for Human-Machine Communication , 2010 .

[8]  Yong Wang,et al.  Conditional Mutual Information‐Based Feature Selection Analyzing for Synergy and Redundancy , 2011, ETRI Journal.

[9]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[10]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[11]  A. Angrilli,et al.  Cardiac responses associated with affective processing of unpleasant film stimuli. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  Christine L. Lisetti,et al.  Bio-sensing for Emotional Characterization without Word Labels , 2009, HCI.

[13]  David G. Stork,et al.  Pattern Classification , 1973 .

[14]  Chang-Hyun Kim,et al.  Feature-Based Relation Classification Using Quantified Relatedness Information , 2010 .

[15]  Lan Li,et al.  Emotion Recognition Using Physiological Signals from Multiple Subjects , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[16]  M. A. Abido Optimal des'ign of Power System Stabilizers Using Particle Swarm Opt'imization , 2002, IEEE Power Engineering Review.

[17]  K Miyoshi,et al.  The influence of psychotic states on the autonomic nervous system in schizophrenia. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  Marc M. Van Hulle Self-organizing Maps , 2012, Handbook of Natural Computing.

[19]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[20]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[21]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[22]  A. Egemen Yilmaz,et al.  Calculation of optimized parameters of rectangular microstrip patch antenna using particle swarm optimization , 2007 .

[23]  Zwe-Lee Gaing,et al.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004 .

[24]  Nicu Sebe,et al.  MULTIMODAL EMOTION RECOGNITION , 2005 .

[25]  Byoung-Jun Park,et al.  Seven emotion recognition by means of particle swarm optimization on physiological signals: Seven emotion recognition , 2012, Proceedings of 2012 9th IEEE International Conference on Networking, Sensing and Control.

[26]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[27]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[28]  Byoung-Jun Park,et al.  Emotion Recognition by Machine Learning Algorithms using Psychophysiological Signals , 2012 .

[29]  J. Arroyo-Palacios Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems , 2008 .

[30]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[31]  Chad L. Stephens,et al.  Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis , 2010, Biological Psychology.