Exploration of Neural Activity under Cognitive Reappraisal Using Simultaneous EEG-fMRI Data and Kernel Canonical Correlation Analysis

Background Neural activity under cognitive reappraisal can be more accurately investigated using simultaneous EEG- (electroencephalography) fMRI (functional magnetic resonance imaging) than using EEG or fMRI only. Complementary spatiotemporal information can be found from simultaneous EEG-fMRI data to study brain function. Method An effective EEG-fMRI fusion framework is proposed in this work. EEG-fMRI data is simultaneously sampled on fifteen visually stimulated healthy adult participants. Net-station toolbox and empirical mode decomposition are employed for EEG denoising. Sparse spectral clustering is used to construct fMRI masks that are used to constrain fMRI activated regions. A kernel-based canonical correlation analysis is utilized to fuse nonlinear EEG-fMRI data. Results The experimental results show a distinct late positive potential (LPP, latency 200-700ms) from the correlated EEG components that are reconstructed from nonlinear EEG-fMRI data. Peak value of LPP under reappraisal state is smaller than that under negative state, however, larger than that under neutral state. For correlated fMRI components, obvious activation can be observed in cerebral regions, e.g., the amygdala, temporal lobe, cingulate gyrus, hippocampus, and frontal lobe. Meanwhile, in these regions, activated intensity under reappraisal state is obviously smaller than that under negative state and larger than that under neutral state. Conclusions The proposed EEG-fMRI fusion approach provides an effective way to study the neural activities of cognitive reappraisal with high spatiotemporal resolution. It is also suitable for other neuroimaging technologies using simultaneous EEG-fMRI data.

[1]  Peng Xu,et al.  A comparative study of different references for EEG default mode network: The use of the infinity reference , 2010, Clinical Neurophysiology.

[2]  R. Simons,et al.  Modulations of the electrophysiological response to pleasant stimuli by cognitive reappraisal. , 2008, Emotion.

[3]  Heather L. Urry,et al.  Using Reappraisal to Regulate Unpleasant Emotional Episodes: Goals and Timing Matter Emotion and Its Regulation , 2022 .

[4]  Hao He,et al.  Building an EEG-fMRI Multi-Modal Brain Graph: A Concurrent EEG-fMRI Study , 2016, Front. Hum. Neurosci..

[5]  R. Zhou,et al.  Cognitive reappraisal of facial expressions: Electrophysiological evidence of social anxiety , 2014, Neuroscience Letters.

[6]  J. Gross Antecedent- and response-focused emotion regulation: divergent consequences for experience, expression, and physiology. , 1998, Journal of personality and social psychology.

[7]  Lilianne R. Mujica-Parodi,et al.  Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: A combined ERP and fMRI study , 2011, NeuroImage.

[8]  Dezhong Yao,et al.  Local Multimodal Serial Analysis for Fusing EEG-fMRI: A New Method to Study Familial Cortical Myoclonic Tremor and Epilepsy , 2015, IEEE Transactions on Autonomous Mental Development.

[9]  Yi Xu,et al.  Functional Connectivity Analysis of Cognitive Reappraisal Using Sparse Spectral Clustering Method , 2016 .

[10]  Thinh Nguyen,et al.  EEG Source Imaging Guided by Spatiotemporal Specific fMRI: Toward an Understanding of Dynamic Cognitive Processes , 2016, Neural plasticity.

[11]  T. Endrass,et al.  Timing effects of antecedent- and response-focused emotion regulation strategies , 2013, Biological Psychology.

[12]  G. Glover,et al.  Reflecting upon Feelings: An fMRI Study of Neural Systems Supporting the Attribution of Emotion to Self and Other , 2004, Journal of Cognitive Neuroscience.

[13]  Karin Coifman,et al.  The Importance of Being Flexible , 2004, Psychological science.

[14]  G. Hajcak,et al.  Event-Related Potentials, Emotion, and Emotion Regulation: An Integrative Review , 2010, Developmental neuropsychology.

[15]  Zhou Ren-lai,et al.  Feature Fusion Analysis of Simultaneously Recorded EEG-fMRI in Emotion Cognitive Reappraisal , 2016 .

[16]  Greg Hajcak,et al.  Previously reappraised: the lasting effect of description type on picture-elicited electrocortical activity. , 2011, Social cognitive and affective neuroscience.

[17]  Greg Hajcak,et al.  Attending to affect: appraisal strategies modulate the electrocortical response to arousing pictures. , 2006, Emotion.

[18]  Vince D. Calhoun,et al.  Multi-set canonical correlation analysis for the fusion of concurrent single trial ERP and functional MRI , 2010, NeuroImage.

[19]  Steven W Anderson,et al.  The effects of voluntary regulation of positive and negative emotion on psychophysiological responsiveness. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  Matthias M. Müller,et al.  Connections between Intraparietal Sulcus and a Sensorimotor Network Underpin Sustained Tactile Attention , 2015, The Journal of Neuroscience.

[21]  Sang Hee Kim,et al.  Neural Correlates of Positive and Negative Emotion Regulation , 2007, Journal of Cognitive Neuroscience.

[22]  R. Davidson,et al.  Dysfunction in the neural circuitry of emotion regulation--a possible prelude to violence. , 2000, Science.

[23]  Aamir Saeed Malik,et al.  Visual brain activity patterns classification with simultaneous EEG-fMRI: A multimodal approach. , 2017, Technology and health care : official journal of the European Society for Engineering and Medicine.

[24]  Sang Hee Kim,et al.  The effect of cognitive reappraisal on physiological reactivity and emotional memory. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  Dezhong Yao,et al.  Why do we need to use a zero reference? Reference influences on the ERPs of audiovisual effects. , 2013, Psychophysiology.

[26]  D. Yao,et al.  A method to standardize a reference of scalp EEG recordings to a point at infinity , 2001, Physiological measurement.

[27]  Vince D. Calhoun,et al.  A Realistic Framework for Investigating Decision Making in the Brain With High Spatiotemporal Resolution Using Simultaneous EEG/fMRI and Joint ICA , 2017, IEEE Journal of Biomedical and Health Informatics.

[28]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[29]  G. Mangun,et al.  Top-down Modulation of Neural Activity in Anticipatory Visual Attention: Control Mechanisms Revealed by Simultaneous EEG-fMRI. , 2014, Cerebral cortex.

[30]  Huijian Dong,et al.  Exotic Collections Asset Pricing: The Lagrangian Optimization , 2015 .