Brain Dynamics During Arousal-Dependent Pleasant/Unpleasant Visual Elicitation: An Electroencephalographic Study on the Circumplex Model of Affect

Emotion regulation to pleasant and unpleasant stimuli involves several brain areas, such as the prefrontal cortex, amygdala, and insular cortex. However, how a specific arousal level affects such brain dynamics is not fully understood. To this effect, we propose an electroencephalography (EEG)-based study, where 22 healthy subjects were emotionally elicited through affective pictures gathered from the International Affective Picture System. Based on the circumplex model of affect, we used four arousing levels, each with two valence levels (i.e., pleasant and unpleasant). Considering these levels, we investigated the EEG power spectra and functional connectivity among channels. We then used this information to build an automatic valence classifier. The experimental results showed that the functional connectivity at the highest frequency bands (i.e., > 30 Hz) was most sensitive to arousal modulation. Specifically, high connectivity over the right hemisphere occurred during pleasant elicitation, whereas that over the left hemisphere occurred during negative elicitation. In addition, short-range connections in the frontal regions became weaker with increased arousal level, whereas long-range connections were enhanced. Concerning the spectral analysis, the most significant valence-dependent changes were found at intermediate arousing elicitations over the prefrontal and occipital regions. The automatic valence classification showed a recognition accuracy of up to 86.37 percent.

[1]  Enzo Pasquale Scilingo,et al.  Assessment of linear and nonlinear/complex heartbeat dynamics in subclinical depression (dysphoria) , 2018, Physiological measurement.

[2]  J. Russell A circumplex model of affect. , 1980 .

[3]  J Theiler,et al.  Two tools to test time series data for evidence of chaos and/or nonlinearity , 1994, Integrative physiological and behavioral science : the official journal of the Pavlovian Society.

[4]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[5]  A. von Stein,et al.  Different frequencies for different scales of cortical integration: from local gamma to long range alpha/theta synchronization. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  L. Sebastiani,et al.  Brain dynamics during emotion elicitation in healthy subjects: An EEG study , 2015, 2015 AEIT International Annual Conference (AEIT).

[7]  Enzo Pasquale Scilingo,et al.  Valence-dependent changes in visual arousing elicitation: An exploratory study in EEG gamma oscillations , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.

[9]  J. Turner Human Emotions: A Sociological Theory , 2007 .

[10]  Cigdem Inan Aci,et al.  A hybrid classification method of k nearest neighbor, Bayesian methods and genetic algorithm , 2010, Expert Syst. Appl..

[11]  Hailemariam Temesgen,et al.  A Comparison of the Spatial Linear Model to Nearest Neighbor (k-NN) Methods for Forestry Applications , 2013, PloS one.

[12]  G. Knyazev,et al.  Event-related delta and theta synchronization during explicit and implicit emotion processing , 2009, Neuroscience.

[13]  W. Ray,et al.  EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. , 1985, Science.

[14]  Elizabeth Duffy,et al.  An Explanation of “Emotional” Phenomena without the use of the Concept “Emotion” , 1941 .

[15]  Matthias R. Lemke,et al.  Modulation of involuntary and voluntary behavior following emotional stimuli in healthy subjects , 2005, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[16]  R. Eckhorn,et al.  Task-related coupling from high- to low-frequency signals among visual cortical areas in human subdural recordings. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[17]  K. Thanushkodi,et al.  An Improved k-Nearest Neighbor Classification Using Genetic Algorithm , 2010 .

[18]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[19]  D. Tucker Lateral brain function, emotion, and conceptualization. , 1981, Psychological bulletin.

[20]  James M Kilner,et al.  Integrated Neural Representations of Odor Intensity and Affective Valence in Human Amygdala , 2005, The Journal of Neuroscience.

[21]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[22]  Matteo Bianchi,et al.  EEG oscillations during caress-like affective haptic elicitation. , 2018, Psychophysiology.

[23]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[24]  Don M. Tucker,et al.  Asymmetric eeg changes as method actors generated emotions , 1984, Biological Psychology.

[25]  R. Spitzer,et al.  The PHQ-9 , 2001, Journal of General Internal Medicine.

[26]  M. Mesulam,et al.  Dissociation of Neural Representation of Intensity and Affective Valuation in Human Gustation , 2003, Neuron.

[27]  Matthias M. Müller,et al.  Processing of affective pictures modulates right-hemispheric gamma band EEG activity , 1999, Clinical Neurophysiology.

[28]  Jiali Ye,et al.  Prevalence, Treatment, and Control of Depressive Symptoms in the United States: Results from the National Health and Nutrition Examination Survey (NHANES), 2005–2008 , 2011, The Journal of the American Board of Family Medicine.

[29]  N. Remmington,et al.  Reexamining the circumplex model of affect. , 2000, Journal of personality and social psychology.

[30]  Barry Horwitz,et al.  The elusive concept of brain connectivity , 2003, NeuroImage.

[31]  G Valenza,et al.  Combining electroencephalographic activity and instantaneous heart rate for assessing brain–heart dynamics during visual emotional elicitation in healthy subjects , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[32]  Reinhard Eckhorn,et al.  A multi-channel correlation method detects traveling γ-waves in monkey visual cortex , 2003, Journal of Neuroscience Methods.

[33]  Julian F Thayer,et al.  The effect of conscious and non-conscious presentation of biologically relevant emotion pictures on emotion modulated startle and phasic heart rate. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  P. Ekman Expression and the Nature of Emotion , 1984 .

[35]  Jiahui Wang,et al.  Identifying valence and arousal levels via connectivity between EEG channels , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[36]  L. Obler,et al.  Right hemisphere emotional perception: evidence across multiple channels. , 1998, Neuropsychology.

[37]  A. Fingelkurts,et al.  Impaired functional connectivity at EEG alpha and theta frequency bands in major depression , 2007, Human brain mapping.

[38]  A. Simoni,et al.  Autonomic and EEG correlates of emotional imagery in subjects with different hypnotic susceptibility , 2003, Brain Research Bulletin.

[39]  Sinan Abo Alchamlat,et al.  KNN-MDR: a learning approach for improving interactions mapping performances in genome wide association studies , 2017, BMC Bioinformatics.

[40]  Seong Youb Chung,et al.  EEG spectral analysis in valence and arousal dimensions of emotion , 2011, 2011 11th International Conference on Control, Automation and Systems.

[41]  Aboul Ella Hassanien,et al.  Intelligent human emotion recognition based on elephant herding optimization tuned support vector regression , 2018, Biomed. Signal Process. Control..

[42]  Craig A. Smith,et al.  Patterns of cognitive appraisal in emotion. , 1985, Journal of personality and social psychology.

[43]  H. Critchley,et al.  Neural correlates of processing valence and arousal in affective words. , 2006, Cerebral cortex.

[44]  Vangelis Sakkalis,et al.  Review of advanced techniques for the estimation of brain connectivity measured with EEG/MEG , 2011, Comput. Biol. Medicine.

[45]  Mohammad Abid Khan,et al.  Effective Use of Evaluation Measures for the Validation of Best Classifier in Urdu Sentiment Analysis , 2017, Cognitive Computation.

[46]  Richard J. Davidson,et al.  Validation of ICA-based myogenic artifact correction for scalp and source-localized EEG , 2010, NeuroImage.

[47]  C. Herrmann,et al.  Gamma responses and ERPs in a visual classification task , 1999, Clinical Neurophysiology.

[48]  Erol Basar,et al.  Emotional face expressions are differentiated with brain oscillations. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[49]  L. Aftanas,et al.  Affective picture processing: event-related synchronization within individually defined human theta band is modulated by valence dimension. , 2001, Neuroscience Letters.

[50]  D. Cicchetti Emotion and Adaptation , 1993 .

[51]  A. Lawrence,et al.  Functional neuroanatomy of emotions: A meta-analysis , 2003, Cognitive, affective & behavioral neuroscience.

[52]  Andreas Daffertshofer,et al.  The relationship between structural and functional connectivity: Graph theoretical analysis of an EEG neural mass model , 2010, NeuroImage.

[53]  K. Pope,et al.  Cognitive tasks augment gamma EEG power , 2004, Clinical Neurophysiology.

[54]  Tanja Schultz,et al.  Towards emotion recognition from electroencephalographic signals , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[55]  Gabriele Eisenhauer,et al.  Neuropsychology Of Emotion , 2016 .

[56]  R. Larsen,et al.  Promises and problems with the circumplex model of emotion. , 1992 .

[57]  John J. B. Allen,et al.  Frontal EEG asymmetry as a moderator and mediator of emotion , 2004, Biological Psychology.

[58]  H. Schlosberg The description of facial expressions in terms of two dimensions. , 1952, Journal of experimental psychology.

[59]  E. Phelps Human emotion and memory: interactions of the amygdala and hippocampal complex , 2004, Current Opinion in Neurobiology.

[60]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[61]  F. Mormann,et al.  Mean phase coherence as a measure for phase synchronization and its application to the EEG of epilepsy patients , 2000 .

[62]  N. Costes,et al.  Emotional Responses to Pleasant and Unpleasant Olfactory, Visual, and Auditory Stimuli: a Positron Emission Tomography Study , 2000, The Journal of Neuroscience.

[63]  E. Fox Emotion Science: Cognitive and Neuroscientific Approaches to Understanding Human Emotions , 2008 .

[64]  M. Bradley,et al.  Neuroanatomical correlates of pleasant and unpleasant emotion , 1997, Neuropsychologia.

[65]  E. Silberman,et al.  Hemispheric lateralization of functions related to emotion , 1986, Brain and Cognition.

[66]  Giulia Varotto,et al.  Music and emotion: An EEG connectivity study in patients with disorders of consciousness , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[67]  J. Russell,et al.  Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. , 1999, Journal of personality and social psychology.

[68]  Yong-Jin Liu,et al.  Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals , 2018, IEEE Transactions on Affective Computing.

[69]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[70]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[71]  Zhaoxiang Zhang,et al.  Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition , 2017, Cognitive Computation.

[72]  C. Goose,et al.  Glossary of Terms , 2004, Machine Learning.

[73]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[74]  P. Whalen,et al.  The structural and functional connectivity of the amygdala: From normal emotion to pathological anxiety , 2011, Behavioural Brain Research.

[75]  G. Glover,et al.  Dissociated neural representations of intensity and valence in human olfaction , 2003, Nature Neuroscience.

[76]  J. Russell Affective space is bipolar. , 1979 .

[77]  D. Ariely,et al.  Beautiful Faces Have Variable Reward Value fMRI and Behavioral Evidence , 2001, Neuron.

[78]  Joseph E LeDoux Emotion circuits in the brain. , 2009, Annual review of neuroscience.

[79]  Rafael Perera,et al.  Personalised care planning for adults with chronic or long-term health conditions. , 2015, The Cochrane database of systematic reviews.

[80]  Wanqing Li,et al.  Arousal modulates valence effects on both early and late stages of affective picture processing in a passive viewing task , 2014, Social neuroscience.

[81]  A. Angrilli,et al.  Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[82]  Stephanie Koch,et al.  Cognitive Neuroscience Of Emotion , 2016 .

[83]  P Rappelsberger,et al.  Long-range EEG synchronization during word encoding correlates with successful memory performance. , 2000, Brain research. Cognitive brain research.

[84]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[85]  Fabio Babiloni,et al.  How to Measure Cerebral Correlates of Emotions in Marketing Relevant Tasks , 2014, Cognitive Computation.

[86]  Angelo Gemignani,et al.  The dynamics of EEG gamma responses to unpleasant visual stimuli: From local activity to functional connectivity , 2012, NeuroImage.

[87]  K. Luan Phan,et al.  Valence, gender, and lateralization of functional brain anatomy in emotion: a meta-analysis of findings from neuroimaging , 2003, NeuroImage.

[88]  Olga Sourina,et al.  Real-time EEG-based emotion recognition for music therapy , 2011, Journal on Multimodal User Interfaces.

[89]  Guillaume Chanel,et al.  Emotion Assessment: Arousal Evaluation Using EEG's and Peripheral Physiological Signals , 2006, MRCS.

[90]  Yuan-Pin Lin,et al.  EEG-based emotion recognition in music listening: A comparison of schemes for multiclass support vector machine , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[91]  F. Artoni,et al.  REMOV: EEG artifacts removal methods during Lokomat lower-limb rehabilitation , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[92]  Dinesh Kant Kumar,et al.  Evaluation of feature extraction techniques in emotional state recognition , 2012, 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI).

[93]  Susan B Perlman,et al.  Regulatory brain development: Balancing emotion and cognition , 2010, Social neuroscience.