Neuroimaging methods in affective neuroscience: selected methodological issues.

A current goal of affective neuroscience is to reveal the relationship between emotion and dynamic brain activity in specific neural circuits. In humans, noninvasive neuroimaging measures are of primary interest in this endeavor. However, methodological issues, unique to each neuroimaging method, have important implications for the design of studies, interpretation of findings, and comparison across studies. With regard to event-related brain potentials, we discuss the need for dense sensor arrays to achieve reference-independent characterization of field potentials and improved estimate of cortical brain sources. Furthermore, limitations and caveats regarding sparse sensor sampling are discussed. With regard to event-related magnetic field (ERF) recordings, we outline a method to achieve magnetoencephalography (MEG) sensor standardization, which improves effects' sizes in typical neuroscientific investigations, avoids the finding of ghost effects, and facilitates comparison of MEG waveforms across studies. Focusing on functional magnetic resonance imaging (fMRI), we question the unjustified application of proportional global signal scaling in emotion research, which can greatly distort statistical findings in key structures implicated in emotional processing and possibly contributing to conflicting results in affective neuroscience fMRI studies, in particular with respect to limbic and paralimbic structures. Finally, a distributed EEG/MEG source analysis with statistical parametric mapping is outlined providing a common software platform for hemodynamic and electromagnetic neuroimaging measures. Taken together, to achieve consistent and replicable patterns of the relationship between emotion and neuroimaging measures, methodological aspects associated with the various neuroimaging techniques may be of similar importance as the definition of emotional cues and task context used to study emotion.

[1]  Niels Birbaumer,et al.  Gender differences in response to pictures of nudes: a magnetoencephalographic study , 2003, Biological Psychology.

[2]  M. Eimer,et al.  The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression. , 2005, Brain research. Cognitive brain research.

[3]  A Gevins,et al.  High resolution EEG: 124-channel recording, spatial deblurring and MRI integration methods. , 1994, Electroencephalography and clinical neurophysiology.

[4]  Joseph Dien,et al.  Issues in the application of the average reference: Review, critiques, and recommendations , 1998 .

[5]  D. Stuss,et al.  Cognitive neuroscience. , 1993, Current opinion in neurobiology.

[6]  Robert Oostenveld,et al.  A comparative study of different references for EEG spectral mapping: the issue of the neutral reference and the use of the infinity reference , 2005, Physiological measurement.

[7]  G. McCarthy,et al.  Dynamic mapping of the human visual cortex by high-speed magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[8]  O Bertrand,et al.  A theoretical justification of the average reference in topographic evoked potential studies. , 1985, Electroencephalography and clinical neurophysiology.

[9]  J. Sarvas Basic mathematical and electromagnetic concepts of the biomagnetic inverse problem. , 1987, Physics in medicine and biology.

[10]  R. B. Silberstein,et al.  Steady-State Visually Evoked Potential Topography during Processing of Emotional Valence in Healthy Subjects , 2002, NeuroImage.

[11]  P. Lang International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[12]  Fusheng Yang,et al.  Standardized shrinking LORETA-FOCUSS (SSLOFO): a new algorithm for spatio-temporal EEG source reconstruction , 2005, IEEE Transactions on Biomedical Engineering.

[13]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  Brigitte Rockstroh,et al.  Processing of emotional adjectives: Evidence from startle EMG and ERPs. , 2006, Psychophysiology.

[15]  M. Bradley,et al.  Affective picture processing: the late positive potential is modulated by motivational relevance. , 2000, Psychophysiology.

[16]  P. Lang,et al.  Fear and anxiety: animal models and human cognitive psychophysiology. , 2000, Journal of affective disorders.

[17]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[18]  M. Junghöfer,et al.  Attention and emotion: an ERP analysis of facilitated emotional stimulus processing , 2003, Neuroreport.

[19]  E. Harth,et al.  Electric Fields of the Brain: The Neurophysics of Eeg , 2005 .

[20]  F. Offner,et al.  The EEG as potential mapping: the value of the average monopolar reference. , 1950, Electroencephalography and clinical neurophysiology.

[21]  K. Luan Phan,et al.  Functional Neuroimaging Studies of Human Emotions , 2004, CNS Spectrums.

[22]  David Poeppel,et al.  Reconstructing spatio-temporal activities of neural sources using an MEG vector beamformer technique , 2001, IEEE Transactions on Biomedical Engineering.

[23]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[24]  Nunez Pl,et al.  Localization of brain activity with electroencephalography. , 1990 .

[25]  Se Robinson,et al.  Functional neuroimaging by Synthetic Aperture Magnetometry (SAM) , 1999 .

[26]  R. Turner,et al.  Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[27]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[28]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[29]  Markus Junghöfer,et al.  Fleeting images: rapid affect discrimination in the visual cortex , 2006, Neuroreport.

[30]  Karl J. Friston,et al.  The Relationship between Global and Local Changes in PET Scans , 1990, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[31]  Jian Le,et al.  Seeing through the skull: Advanced EEGs use MRIs to accurately measure cortical activity from the scalp , 2005, Brain Topography.

[32]  M. Eimer Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. , 2000, Brain research. Cognitive brain research.

[33]  Roman Ferstl,et al.  Convergent and divergent effects of odors and emotions in depression. , 2003, Psychophysiology.

[34]  D. Tucker,et al.  Spatial sampling and filtering of EEG with spline Laplacians to estimate cortical potentials , 2005, Brain Topography.

[35]  M-X Huang,et al.  Commonalities and Differences Among Vectorized Beamformers in Electromagnetic Source Imaging , 2003, Brain Topography.

[36]  Paul Pauli,et al.  Modulation of event-related brain potentials during affective picture processing: a complement to startle reflex and skin conductance response? , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[37]  Jens Frahm,et al.  COMMENTS AND CONTROVERSIES Functional MRI of the Human Amygdala , 2001 .

[38]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[39]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[40]  M. Junghöfer,et al.  The facilitated processing of threatening faces: an ERP analysis. , 2004, Emotion.

[41]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[42]  Xavier Tricoche,et al.  Influence of tissue conductivity anisotropy on EEG/MEG field and return current computation in a realistic head model: A simulation and visualization study using high-resolution finite element modeling , 2006, NeuroImage.

[43]  R. Hari,et al.  Magnetoencephalography in the study of human somatosensory cortical processing. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[44]  Kara D. Federmeier,et al.  Event-related brain potentials. , 1990 .

[45]  A. Lawrence,et al.  Functional neuroanatomy of emotions: A meta-analysis , 2003, Cognitive, affective & behavioral neuroscience.

[46]  W. Skrandies,et al.  Dimensions of affective semantic meaning — behavioral and evoked potential correlates in Chinese subjects , 2003, Neuroscience Letters.

[47]  K. Luan Phan,et al.  Valence, gender, and lateralization of functional brain anatomy in emotion: a meta-analysis of findings from neuroimaging , 2003, NeuroImage.

[48]  Andreas Keil,et al.  Additive effects of emotional content and spatial selective attention on electrocortical facilitation. , 2005, Cerebral cortex.

[49]  Luis Carretié,et al.  Automatic attention to emotional stimuli: Neural correlates , 2004, Human brain mapping.

[50]  Paul Pauli,et al.  Electrocortical evidence for an early abnormal processing of panic-related words in panic disorder patients. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[51]  M. Bradley,et al.  Brain potentials in affective picture processing: covariation with autonomic arousal and affective report , 2000, Biological Psychology.

[52]  Dieter Vaitl,et al.  Neuroimaging of emotion: empirical effects of proportional global signal scaling in fMRI data analysis , 2005, NeuroImage.

[53]  R. LorentedeNo Analysis of the distribution of the action currents of nerve in volume conductors. , 1947 .

[54]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[55]  M. Mintun,et al.  Enhanced Detection of Focal Brain Responses Using Intersubject Averaging and Change-Distribution Analysis of Subtracted PET Images , 1988, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[56]  J. Cacioppo,et al.  Handbook of psychophysiology (2nd ed.). , 2000 .

[57]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[58]  Jesper L. R. Andersson,et al.  How to Estimate Global Activity Independent of Changes in Local Activity , 1997, NeuroImage.

[59]  F. Perrin,et al.  Spherical splines for scalp potential and current density mapping. , 1989, Electroencephalography and clinical neurophysiology.

[60]  Marcus E. Raichle,et al.  Cognitive neuroscience: Bold insights , 2001, Nature.

[61]  Karl J. Friston,et al.  Studying spontaneous EEG activity with fMRI , 2003, Brain Research Reviews.

[62]  E. Rolls,et al.  The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology , 2004, Progress in Neurobiology.

[63]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[64]  John W McCrary,et al.  Behavioral and neural analyses of connotative meaning: Word classes and rating scales , 1980, Brain and Language.

[65]  B.N. Cuffin,et al.  EEG localization accuracy improvements using realistically shaped head models , 1996, IEEE Transactions on Biomedical Engineering.

[66]  M. Eimer,et al.  The processing of emotional facial expression is gated by spatial attention: evidence from event-related brain potentials. , 2003, Brain research. Cognitive brain research.

[67]  Leslie G. Ungerleider,et al.  Attentional control of the processing of neural and emotional stimuli. , 2002, Brain research. Cognitive brain research.

[68]  Gilles Pourtois,et al.  Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[69]  Olivier Bertrand,et al.  Scalp Current Density Mapping: Value and Estimation from Potential Data , 1987, IEEE Transactions on Biomedical Engineering.

[70]  Karl J. Friston,et al.  Changes in global cerebral blood flow in humans: effect on regional cerebral blood flow during a neural activation task. , 1993, The Journal of physiology.

[71]  D. Tucker,et al.  Frontolimbic response to negative feedback in clinical depression. , 2003, Journal of abnormal psychology.

[72]  M. Scherg,et al.  Two bilateral sources of the late AEP as identified by a spatio-temporal dipole model. , 1985, Electroencephalography and clinical neurophysiology.

[73]  Martin Burghoff,et al.  Conversion of magnetocardiographic recordings between two different multichannel SQUID devices , 2000, IEEE Transactions on Biomedical Engineering.

[74]  Th R Knösche,et al.  Transformation of Whole-Head MEG Recordings Between Different Sensor Positions / Transformation von Ganzkopf-MEG-Messungen zwischen verschiedenen Sensorpositionen , 2002, Biomedizinische Technik. Biomedical engineering.

[75]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[76]  R. Lorente de Nó,et al.  Analysis of the distribution of the action currents of nerve in volume conductors. , 1947, Studies from the Rockefeller institute for medical research. Reprints. Rockefeller Institute for Medical Research.

[77]  P. Nunez Estimation of large scale neocortical source activity with EEG surface Laplacians , 2005, Brain Topography.

[78]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[79]  K. Luan Phan,et al.  Functional Neuroanatomy of Emotion: A Meta-Analysis of Emotion Activation Studies in PET and fMRI , 2002, NeuroImage.

[80]  Stephan Arndt,et al.  Normalizing Counts and Cerebral Blood Flow Intensity in Functional Imaging Studies of the Human Brain , 1996, NeuroImage.

[81]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[82]  B. Rockstroh,et al.  Mapping EEG-potentials on the surface of the brain: A strategy for uncovering cortical sources , 2005, Brain Topography.

[83]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[84]  M. D’Esposito,et al.  The Inferential Impact of Global Signal Covariates in Functional Neuroimaging Analyses , 1998, NeuroImage.

[85]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[86]  E. Phelps Human emotion and memory: interactions of the amygdala and hippocampal complex , 2004, Current Opinion in Neurobiology.

[87]  H. Spekreijse,et al.  Mathematical dipoles are adequate to describe realistic generators of human brain activity , 1988, IEEE Transactions on Biomedical Engineering.

[88]  H. Berger Über das Elektrenkephalogramm des Menschen , 1929, Archiv für Psychiatrie und Nervenkrankheiten.

[89]  E. Bernat,et al.  Event-related brain potentials differentiate positive and negative mood adjectives during both supraliminal and subliminal visual processing. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[90]  M. Junghöfer,et al.  The polar average reference effect: a bias in estimating the head surface integral in EEG recording , 1999, Clinical Neurophysiology.

[91]  Christoph M. Michel,et al.  Electrical neuroimaging reveals early generator modulation to emotional words , 2004, NeuroImage.

[92]  Markus Junghöfer,et al.  Stimulus novelty and emotion perception: the near absence of habituation in the visual cortex , 2006, Neuroreport.

[93]  Luis Carretié,et al.  Cortical response to subjectively unconscious danger , 2005, NeuroImage.

[94]  M. Raichle,et al.  Anatomic Localization and Quantitative Analysis of Gradient Refocused Echo-Planar fMRI Susceptibility Artifacts , 1997, NeuroImage.

[95]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[96]  Christoph M. Michel,et al.  Two electrophysiological stages of spatial orienting towards fearful faces: early temporo-parietal activation preceding gain control in extrastriate visual cortex , 2005, NeuroImage.

[97]  C. Tomes CHEMISTRY AND PHYSICS , 1903 .

[98]  M. Hämäläinen Magnetoencephalography: A tool for functional brain imaging , 2005, Brain Topography.

[99]  S. Hamann,et al.  Positive and negative emotional verbal stimuli elicit activity in the left amygdala , 2002, Neuroreport.

[100]  B. Parkinson,et al.  Emotion and motivation , 1995 .

[101]  Y. Yamashita Theoretical Studies on the Inverse Problem in Electrocardiography and the Uniqueness of the Solution , 1982, IEEE Transactions on Biomedical Engineering.

[102]  O D Creutzfeldt,et al.  Relations between EEG phenomena and potentials of single cortical cells. I. Evoked responses after thalamic and erpicortical stimulation. , 1966, Electroencephalography and clinical neurophysiology.

[103]  Dorothy S. Russell,et al.  Pathology of Tumours of the Nervous System , 1972 .

[104]  H. Meeren,et al.  Rapid perceptual integration of facial expression and emotional body language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[105]  R. Caton The Electric Currents of the Brain , 1970 .

[106]  Ravi S. Menon,et al.  Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[107]  J. Desmond,et al.  Seeing through the skull: advanced EEGs use MRIs to accurately measure cortical activity from the scalp. , 1991 .

[108]  Jens Frahm,et al.  COMMENTS AND CONTROVERSIES Functional MRI of the Human Amygdala , 2001 .

[109]  Ana Susac,et al.  Neurodynamic Studies on Emotional and Inverted Faces in an Oddball Paradigm , 2003, Brain Topography.

[110]  Leonid Zhukov,et al.  Lead-field Bases for Electroencephalography Source Imaging , 2000, Annals of Biomedical Engineering.

[111]  R. S. Hinks,et al.  Time course EPI of human brain function during task activation , 1992, Magnetic resonance in medicine.

[112]  A. Keil,et al.  Modulation of the C1 visual event-related component by conditioned stimuli: evidence for sensory plasticity in early affective perception. , 2006, Cerebral cortex.

[113]  D. Grandjean,et al.  Electrophysiological correlates of rapid spatial orienting towards fearful faces. , 2004, Cerebral cortex.

[114]  H. Helmholtz Ueber einige Gesetze der Vertheilung elektrischer Ströme in körperlichen Leitern mit Anwendung auf die thierisch‐elektrischen Versuche , 1853 .

[115]  B. Rockstroh,et al.  Statistical control of artifacts in dense array EEG/MEG studies. , 2000, Psychophysiology.

[116]  D. Tucker Spatial sampling of head electrical fields: the geodesic sensor net. , 1993, Electroencephalography and clinical neurophysiology.

[117]  Michael Davis,et al.  The amygdala: vigilance and emotion , 2001, Molecular Psychiatry.

[118]  R. Sternbach,et al.  Principles of Psychophysiology , 1966 .

[119]  H. Larsson,et al.  Small-Scale Molecular Motions Accomplish Glutamate Uptake in Human Glutamate Transporters , 2005, The Journal of Neuroscience.

[120]  Harald T. Schupp,et al.  Emotional Facilitation of Sensory Processing in the Visual Cortex , 2003, Psychological science.

[121]  T. Elbert,et al.  Comparison of data transformation procedures to enhance topographical accuracy in time-series analysis of the human EEG , 2002, Journal of Neuroscience Methods.

[122]  J. Nenonen,et al.  Transformation of multichannel magnetocardiographic signals to standard grid form , 1995, IEEE Transactions on Biomedical Engineering.