Emotion classification during music listening from forehead biosignals

Emotion recognition systems are helpful in human–machine interactions and clinical applications. This paper investigates the feasibility of using 3-channel forehead biosignals (left temporalis, frontalis, and right temporalis channel) as informative channels for emotion recognition during music listening. Classification of four emotional states (positive valence/low arousal, positive valence/high arousal, negative valence/high arousal, and negative valence/low arousal) in arousal–valence space was performed by employing two parallel cascade-forward neural networks as arousal and valence classifiers. The inputs of the classifiers were obtained by applying a fuzzy rough model feature evaluation criterion and sequential forward floating selection algorithm. An averaged classification accuracy of 87.05 % was achieved, corresponding to average valence classification accuracy of 93.66 % and average arousal classification accuracy of 93.29 %.

[1]  John Benjafield,et al.  Cognition, 3rd ed. , 2007 .

[2]  Qinghua Hu,et al.  Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation , 2007, Pattern Recognit..

[3]  D. Västfjäll,et al.  Emotional responses to music: the need to consider underlying mechanisms. , 2008, The Behavioral and brain sciences.

[4]  Olga Sourina,et al.  Real-Time EEG-Based Human Emotion Recognition and Visualization , 2010, 2010 International Conference on Cyberworlds.

[5]  N. Rickard,et al.  Relaxing music prevents stress-induced increases in subjective anxiety, systolic blood pressure, and heart rate in healthy males and females. , 2001, Journal of music therapy.

[6]  L Bernardi,et al.  Cardiovascular, cerebrovascular, and respiratory changes induced by different types of music in musicians and non-musicians: the importance of silence , 2005, Heart.

[7]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[8]  C. Witvliet,et al.  Play it again Sam: Repeated exposure to emotionally evocative music polarises liking and smiling responses, and influences other affective reports, facial EMG, and heart rate , 2007 .

[9]  L. Trainor,et al.  Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions , 2001 .

[10]  M. Grigutsch,et al.  Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music. , 2007, Psychophysiology.

[11]  J. Pickens,et al.  Music shifts frontal EEG in depressed adolescents. , 1998, Adolescence.

[12]  A. Friederici,et al.  Investigating emotion with music: An fMRI study , 2006, Human brain mapping.

[13]  Egon L. van den Broek,et al.  Personalized affective music player , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[14]  Joydeep Bhattacharya,et al.  Phase synchrony analysis of EEG during music perception reveals changes in functional connectivity due to musical expertise , 2005, Signal Process..

[15]  N. Pop-Jordanova,et al.  Spectrum-weighted EEG frequency ("brain-rate") as a quantitative indicator of mental arousal. , 2005, Prilozi.

[16]  M. Yik.  A circumplex model of affect and its relation to personality : a five-language study , 1999 .

[17]  Paul J. Silvia,et al.  Positive and Negative Affect: Bridging States and Traits. , 2006 .

[18]  Brian Litt,et al.  Epileptic seizure prediction using hybrid feature selection over multiple intracranial EEG electrode contacts: a report of four patients , 2003, IEEE Transactions on Biomedical Engineering.

[19]  G. Scott Vercoe,et al.  The affective remixer: personalized music arranging , 2006, CHI Extended Abstracts.

[20]  Hiok Chai Quek,et al.  The dynamic emotion recognition system based on functional connectivity of brain regions , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[21]  Alan C. Evans,et al.  Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions , 1999, Nature Neuroscience.

[22]  I. Peretz,et al.  The Cognitive Neuroscience of Music , 2003 .

[23]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Laurel J. Trainor,et al.  Processing Emotions Induced by Music , 2003 .

[25]  Huosheng Hu,et al.  A Human – Computer Interface based on Forehead Multi-Channel Bio-signals to Control a Virtual Wheelchair , 2002 .

[26]  Seiji Inokuchi,et al.  An Approach to Analysis of EEGs Recorded During Music Listening , 1997 .

[27]  R. A. Pavlygina,et al.  Spectral Analysis of the Human EEG during Listening to Musical Compositions , 2004, Human Physiology.

[28]  F. Barrios,et al.  Metabolic and electric brain patterns during pleasant and unpleasant emotions induced by music masterpieces. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  Iman Mohammad Rezazadeh,et al.  Discriminating affective states in music induction environment using forehead bioelectric signals , 2011, 2011 1st Middle East Conference on Biomedical Engineering.

[30]  Yuan-Pin Lin,et al.  EEG-Based Emotion Recognition in Music Listening , 2010, IEEE Transactions on Biomedical Engineering.

[31]  Xiangyu Wang,et al.  Using affective human-machine interface to increase the operation performance in virtual construction crane training system: A novel approach , 2011 .

[32]  R. A. Mcfarland.  Relationship of skin temperature changes to the emotions accompanying music , 1985, Biofeedback and self-regulation.

[33]  Yvonne Tran,et al.  The effect of music on brain wave functioning during an acute psychotic episode: A pilot study , 2010, Psychiatry Research.

[34]  Christian Gold,et al.  The effect of improvisational music therapy on the treatment of depression: protocol for a randomised controlled trial , 2008, BMC psychiatry.

[35]  E. Sokhadze.  Effects of Music on the Recovery of Autonomic and Electrocortical Activity After Stress Induced by Aversive Visual Stimuli , 2007, Applied psychophysiology and biofeedback.