Music induced emotion using wavelet packet decomposition - An EEG study

Abstract Music has the potential to invoke strong emotions, both positive and negative, wherein positive emotions can augment well-being. The objective of this study was to analyze the dynamic emotional responses of the participants to self-selected music using Electroencephalography (EEG). The frequency localization with respect to time for the given stimulus (liked and disliked music) in various EEG bands was established by implementing a multi-resolution analysis algorithm using Wavelet Packet Decomposition (WPD).Ten healthy adults with an average age of 20 years (without any formal training in music) participated in this study. The perceived emotion of the participants was assessed using Self-Assessment Manikin (SAM) scale and brain activity,while they were listening to music,was recorded using EEG. A high frontal asymmetry index score was noted at mid-frontal (F3 and F4) and lateral frontal (F7 and F8) electrode locations indicating positive emotion. The result suggests that playing the disliked music elicits neither negative emotion nor positive emotion as the changes were noted only at lateral frontal (F4 and F3). Apart from these, there was an increase in the theta band energy of the frontal midline only for liked music and increased beta component energy was observed only at frontal electrode locations while listening to disliked music. The participants’ perceived emotion (valence/arousal) matched with induced emotion for liked music whereas for disliked music only the arousal component was similar.

[1]  J. Rohrbaugh,et al.  Beta power in the EEG of alcoholics , 2002, Biological Psychiatry.

[2]  G. Schwartz,et al.  Differential lateralization for positive and negative emotion in the human brain: EEG spectral analysis , 1985, Neuropsychologia.

[3]  Daniel Västfjäll,et al.  Experimental evidence of the roles of music choice, social context, and listener personality in emotional reactions to music , 2013 .

[4]  J. Tsai.  Ideal Affect: Cultural Causes and Behavioral Consequences , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[5]  Quan Wang,et al.  The application study of wavelet packet transformation in the de-noising of dynamic EEG data. , 2015, Bio-medical materials and engineering.

[6]  A. Friederici,et al.  Investigating emotion with music: An fMRI study , 2006, Human brain mapping.

[7]  P. Laukka,et al.  Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening , 2004 .

[8]  E. Schellenberg,et al.  The role of exposure in emotional responses to music , 2008 .

[9]  John J. B. Allen,et al.  Frontal EEG asymmetry as a moderator and mediator of emotion , 2004, Biological Psychology.

[10]  Weifeng Sun,et al.  Generalized wavelet product integral for rendering dynamic glossy objects , 2006, SIGGRAPH 2006.

[11]  Yan Li,et al.  A new approach to denoising EEG signals - merger of translation invariant wavelet and ICA , 2011 .

[12]  R. Quian Quiroga,et al.  Single-trial event-related potentials with wavelet denoising , 2003, Clinical Neurophysiology.

[13]  C. Izard.  Basic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[14]  R. A. Pavlygina,et al.  The human EEG in recognition of noisy visual images accompanied by music , 2007, Human Physiology.

[15]  I. Daubechies,et al.  Biorthogonal bases of compactly supported wavelets , 1992 .

[16]  Julian F. Thayer,et al.  Does resting electroencephalograph asymmetry reflect a trait? an application of latent state-trait theory. , 2002 .

[17]  Patch Beadle,et al.  Multiresolution of Clinical EEG Recordings Based on Wavelet Packet Analysis , 2007, ISNN.

[18]  Siti Anom Ahmad,et al.  Selection of Mother Wavelet Functions for Multi-Channel EEG Signal Analysis during a Working Memory Task , 2015, Sensors.

[19]  Ranjan Sengupta,et al.  Study on Brain Dynamics by Non Linear Analysis of Music Induced EEG Signals , 2016 .

[20]  E. Basar,et al.  Wavelet entropy: a new tool for analysis of short duration brain electrical signals , 2001, Journal of Neuroscience Methods.

[21]  J. Panksepp,et al.  Emotional sounds and the brain: the neuro-affective foundations of musical appreciation , 2002, Behavioural Processes.

[22]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[23]  P. Lang.  International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[24]  John J. B. Allen,et al.  Voluntary facial expression and hemispheric asymmetry over the frontal cortex. , 2001, Psychophysiology.

[25]  E. Brattico,et al.  Music and Emotions in the Brain: Familiarity Matters , 2011, PloS one.

[26]  E. Schellenberg,et al.  Current Emotion Research in Music Psychology , 2015 .

[27]  Ronald R. Coifman,et al.  Wavelet analysis and signal processing , 1990 .

[28]  J P Macher,et al.  Neural network model: application to automatic analysis of human sleep. , 1993, Computers and biomedical research, an international journal.

[29]  Hui Zhang,et al.  Wavelet packet transform for feature extraction of EEG during mental tasks , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[30]  Keikichi Hirose,et al.  Artifact suppression and analysis of brain activities with electroencephalography signals , 2013, Neural regeneration research.

[31]  Yan Guozheng,et al.  EEG feature extraction based on wavelet packet decomposition for brain computer interface , 2008 .

[32]  M. Teplan.  FUNDAMENTALS OF EEG MEASUREMENT , 2002 .

[33]  K. Heilman.  Emotional experience: A neurological model. , 2000 .

[34]  S. Muthukumaraswamy.  High-frequency brain activity and muscle artifacts in MEG/EEG: a review and recommendations , 2013, Front. Hum. Neurosci..

[35]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[36]  R. Zatorre,et al.  Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Guoliang Chang,et al.  Wavelet Packet Entropy in the Analysis of EEG Signals , 2006, 2006 8th international Conference on Signal Processing.

[38]  Norizam Sulaiman,et al.  Stress features identification from EEG signals using EEG Asymmetry & Spectral Centroids techniques , 2010, 2010 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[39]  N. Geschwind,et al.  Hemispheric asymmetry in the expression of positive and negative emotions. Neurologic evidence. , 1982, Archives of neurology.

[40]  L J Trainor,et al.  Frontal EEG Responses as a Function of Affective Musical Features , 2001, Annals of the New York Academy of Sciences.

[41]  U. Rajendra Acharya,et al.  EEG Signal Analysis: A Survey , 2010, Journal of Medical Systems.

[42]  M. Grigutsch,et al.  Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music. , 2007, Psychophysiology.

[43]  Andrew P. Bradley.  Shift-invariance in the Discrete Wavelet Transform , 2003, DICTA.

[44]  I. Peretz,et al.  Music listening enhances cognitive recovery and mood after middle cerebral artery stroke. , 2008, Brain : a journal of neurology.

[45]  P. Ekman,et al.  The Duchenne smile: emotional expression and brain physiology. II. , 1990, Journal of personality and social psychology.

[46]  S. Mallat.  Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[47]  D. Lee Fugal,et al.  Conceptual wavelets in digital signal processing : an in-depth, practical approach for the non-mathematician , 2009 .

[48]  Nutankumar S. Thingujam,et al.  Universal and culture-specific factors in the recognition and performance of musical affect expressions. , 2013, Emotion.

[49]  Isabelle Peretz,et al.  Music and Speech Listening Enhance the Recovery of Early Sensory Processing after Stroke , 2010, Journal of Cognitive Neuroscience.

[50]  W. Thompson,et al.  Recognition of emotion in Japanese, Western, and Hindustani music by Japanese listeners 1 , 2004 .

[51]  Patrick C M Wong,et al.  Bimusicalism: The Implicit Dual Enculturation of Cognitive and Affective Systems. , 2009, Music perception.

[52]  L. Trainor,et al.  Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions , 2001 .

[53]  B. Geethanjali,et al.  Enhancement of Task Performance Aided by Music , 2016 .