Investigation of Familiarity Effects in Music-Emotion Recognition Based on EEG

Familiarity is a crucial subjectivity issue in music perception that is often overlooked in neural correlate studies and emotion recognition research. We investigated the effects of familiarity to brain activity based on electroencephalogram (EEG). In our research, we focused on self-reporting and continuous annotation based on the hypothesis that the emotional state in music experiencing is subjective and changes over time. Our methodology allowed subjects to select 16 MIDI songs, comprised of 8 familiar and 8 unfamiliar songs. We found evidence that music familiarity induces changes in power spectral density and brain functional connectivity. Furthermore, the empirical results suggest that using songs with low familiarity could slightly enhance EEG-based emotion classification performance with fractal dimension or power spectral density feature extraction algorithms and support vector machine, multi-layer perceptron or C4.5 classifiers. Therefore, unfamiliar songs would be most appropriate for emotion recognition system construction.

[1]  Robert J. Zatorre,et al.  Familiarity mediates the relationship between emotional arousal and pleasure during music listening , 2013, Front. Hum. Neurosci..

[2]  Charan Ranganath,et al.  Frontal midline theta oscillations during working memory maintenance and episodic encoding and retrieval , 2014, NeuroImage.

[3]  Barbara Tillmann,et al.  The feeling of familiarity of music and odors: the same neural signature? , 2007, Cerebral cortex.

[4]  E. Brattico,et al.  Music and Emotions in the Brain: Familiarity Matters , 2011, PloS one.

[5]  T. Higuchi Approach to an irregular time series on the basis of the fractal theory , 1988 .

[6]  Barbara Tillmann,et al.  Temporal Aspects of the Feeling of Familiarity for Music and the Emergence of Conceptual Processing , 2010, Journal of Cognitive Neuroscience.

[7]  L. Aftanas,et al.  Human anterior and frontal midline theta and lower alpha reflect emotionally positive state and internalized attention: high-resolution EEG investigation of meditation , 2001, Neuroscience Letters.

[8]  M. Grigutsch,et al.  Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music. , 2007, Psychophysiology.

[9]  L. Trainor,et al.  Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions , 2001 .

[10]  A. Burgess,et al.  Functional connectivity of gamma EEG activity is modulated at low frequency during conscious recollection. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Hervé Platel,et al.  Functional Neuroimaging of Semantic and Episodic Musical Memory , 2005, Annals of the New York Academy of Sciences.

[12]  Miyoung Kim,et al.  A Review on the Computational Methods for Emotional State Estimation from the Human EEG , 2013, Comput. Math. Methods Medicine.

[13]  Homer H. Chen,et al.  Music Emotion Recognition , 2011 .

[14]  Riccardo Brunetti,et al.  Modification of EEG power spectra and EEG connectivity in autobiographical memory: a sLORETA study , 2014, Cognitive Processing.

[15]  J. Russell A circumplex model of affect. , 1980 .

[16]  S. Hsieh,et al.  Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns , 2014, PloS one.

[17]  Olga Sourina,et al.  Real-time EEG-based emotion recognition for music therapy , 2011, Journal on Multimodal User Interfaces.