Rapid and highly resolving associative affective learning: Convergent electro- and magnetoencephalographic evidence from vision and audition

Various pathway models for emotional processing suggest early prefrontal contributions to affective stimulus evaluation. Yet, electrophysiological evidence for such rapid modulations is still sparse. In a series of four MEG/EEG studies which investigated associative learning in vision and audition using a novel MultiCS Conditioning paradigm, many different neutral stimuli (faces, tones) were paired with aversive and appetitive events in only two to three learning instances. Electrophysiological correlates of neural activity revealed highly significant amplified processing for conditioned stimuli within distributed prefrontal and sensory cortical networks. In both, vision and audition, affect-specific responses occurred in two successive waves of rapid (vision: 50-80 ms, audition: 25-65 ms) and mid-latency (vision: >130 ms, audition: >100 ms) processing. Interestingly, behavioral measures indicated that MultiCS Conditioning successfully prevented contingency awareness. We conclude that affective processing rapidly recruits highly elaborate and widely distributed networks with substantial capacity for fast learning and excellent resolving power.

[1]  M. Junghöfer,et al.  Attention and emotion: an ERP analysis of facilitated emotional stimulus processing , 2003, Neuroreport.

[2]  Joseph E LeDoux Fear and the brain: where have we been, and where are we going? , 1998, Biological Psychiatry.

[3]  Markus Junghöfer,et al.  Fleeting images: rapid affect discrimination in the visual cortex , 2006, Neuroreport.

[4]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Patrik Vuilleumier,et al.  EEG-MEG evidence for early differential repetition effects for fearful, happy and neutral faces , 2009, Brain Research.

[6]  Andreas Keil,et al.  Adaptation in human visual cortex as a mechanism for rapid discrimination of aversive stimuli , 2007, NeuroImage.

[7]  Gilles Pourtois,et al.  Dynamics of emotional effects on spatial attention in the human visual cortex. , 2006, Progress in brain research.

[8]  B. Nagengast,et al.  Evaluative conditioning and the awareness issue: assessing contingency awareness with the four-picture recognition test. , 2006, Journal of experimental psychology. Animal behavior processes.

[9]  Dieter Vaitl,et al.  Neuroimaging of emotion: empirical effects of proportional global signal scaling in fMRI data analysis , 2005, NeuroImage.

[10]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[11]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[12]  Markus Junghöfer,et al.  Selective Visual Attention to Emotion , 2007, The Journal of Neuroscience.

[13]  F. Carver,et al.  Visual Awareness, Emotion, and Gamma Band Synchronization , 2008, Cerebral cortex.

[14]  Michel Baudry,et al.  The amygdala modulates prefrontal cortex activity relative to conditioned fear , 1999, Nature.

[15]  P. Morgane,et al.  A review of systems and networks of the limbic forebrain/limbic midbrain , 2005, Progress in Neurobiology.

[16]  R. Dolan,et al.  Distant influences of amygdala lesion on visual cortical activation during emotional face processing , 2004, Nature Neuroscience.

[17]  A. Keil,et al.  Modulation of the C1 visual event-related component by conditioned stimuli: evidence for sensory plasticity in early affective perception. , 2006, Cerebral cortex.

[18]  D. Grandjean,et al.  Electrophysiological correlates of rapid spatial orienting towards fearful faces. , 2004, Cerebral cortex.

[19]  S. Rauch,et al.  A functional magnetic resonance imaging study of amygdala and medial prefrontal cortex responses to overtly presented fearful faces in posttraumatic stress disorder. , 2005, Archives of general psychiatry.

[20]  J. Duncan,et al.  Prefrontal cortical function and anxiety: controlling attention to threat-related stimuli , 2004, Nature Neuroscience.

[21]  R. Dolan,et al.  The Nose Smells What the Eye Sees Crossmodal Visual Facilitation of Human Olfactory Perception , 2003, Neuron.

[22]  R. Davidson,et al.  The functional neuroanatomy of emotion and affective style , 1999, Trends in Cognitive Sciences.

[23]  Joseph E LeDoux The emotional brain , 1996 .

[24]  Bruno Rossion,et al.  Category Specificity in Early Perception: Face and Word N170 Responses Differ in Both Lateralization and Habituation Properties , 2008, Frontiers in human neuroscience.

[25]  Karl J. Friston,et al.  Brain systems mediating aversive conditioning: An event related fMRI study , 1998, NeuroImage.

[26]  M. Bradley,et al.  Affective reactions to acoustic stimuli. , 2000, Psychophysiology.

[27]  I. Hashimoto,et al.  Rapid change of tonotopic maps in the human auditory cortex during pitch discrimination , 2004, Clinical Neurophysiology.

[28]  B. Rockstroh,et al.  Statistical control of artifacts in dense array EEG/MEG studies. , 2000, Psychophysiology.

[29]  N. Weinberger Specific long-term memory traces in primary auditory cortex , 2004, Nature Reviews Neuroscience.

[30]  Alan Cowey,et al.  The neurobiology of blindsight , 1991, Trends in Neurosciences.

[31]  H Scheich,et al.  Auditory perception of laughing and crying activates human amygdala regardless of attentional state. , 2001, Brain research. Cognitive brain research.

[32]  Joseph E LeDoux,et al.  Fear conditioning enhances short-latency auditory responses of lateral amygdala neurons: Parallel recordings in the freely behaving rat , 1995, Neuron.

[33]  Andreas Keil,et al.  Not what you expect: experience but not expectancy predicts conditioned responses in human visual and supplementary cortex. , 2009, Cerebral cortex.

[34]  Hanna Damasio,et al.  Single-neuron responses to emotional visual stimuli recorded in human ventral prefrontal cortex , 2001, Nature Neuroscience.

[35]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[36]  O. Luminet,et al.  Aware and (dis)liking: item-based analyses reveal that valence acquisition via evaluative conditioning emerges only when there is contingency awareness. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[37]  C. Gilbert,et al.  Perceptual learning and top-down influences in primary visual cortex , 2004, Nature Neuroscience.

[38]  R. James R. Blair,et al.  Neural dynamics for facial threat processing as revealed by gamma band synchronization using MEG , 2007, NeuroImage.

[39]  B. Rockstroh,et al.  The Tortured Brain , 2008 .

[40]  Michael Davis,et al.  The amygdala , 2000, Current Biology.

[41]  R. Dolan,et al.  Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value , 2004, Nature Neuroscience.

[42]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[43]  M. Lappe,et al.  A method for the estimation of functional brain connectivity from time-series data , 2010, Cognitive Neurodynamics.

[44]  C. Mervis,et al.  Neural correlates of genetically abnormal social cognition in Williams syndrome , 2005, Nature Neuroscience.

[45]  A. Belger,et al.  Midlatency evoked potentials attenuation and augmentation reflect different aspects of sensory gating , 1999, Biological Psychiatry.

[46]  H. Barbas,et al.  Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey , 2002, Neuroscience.

[47]  Andreas Keil,et al.  Fear but not awareness predicts enhanced sensory processing in fear conditioning. , 2006, Psychophysiology.

[48]  Asaid Khateb,et al.  Electrophysiological correlates of affective blindsight , 2009, NeuroImage.

[49]  Stefan Wiens,et al.  Unawareness is more than a chance event: comment on Lovibond and Shanks (2002). , 2002, Journal of experimental psychology. Animal behavior processes.

[50]  Olaf Hauk,et al.  Keep it simple: a case for using classical minimum norm estimation in the analysis of EEG and MEG data , 2004, NeuroImage.

[51]  F. Baeyens,et al.  Contingency awareness in evaluative conditioning: A case for unaware affective-evaluative learning , 1990 .

[52]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[53]  D. Shanks,et al.  The role of awareness in Pavlovian conditioning: empirical evidence and theoretical implications. , 2002, Journal of experimental psychology. Animal behavior processes.

[54]  L. Weiskrantz Blindsight revisited , 1996, Current Opinion in Neurobiology.

[55]  M. Junghöfer,et al.  Emotion and attention: event-related brain potential studies. , 2006, Progress in brain research.

[56]  L. Weiskrantz,et al.  Differential extrageniculostriate and amygdala responses to presentation of emotional faces in a cortically blind field. , 2001, Brain : a journal of neurology.

[57]  D. Amaral,et al.  Synaptic organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey , 2005, The Journal of comparative neurology.

[58]  O. Lipp,et al.  Does Affective Learning Exist in the Absence of Contingency Awareness , 2001 .

[59]  Joseph E LeDoux,et al.  Fear conditioning induces associative long-term potentiation in the amygdala , 1997, Nature.

[60]  S Braeutigam,et al.  Task-dependent early latency (30–60 ms) visual processing of human faces and other objects , 2001, Neuroreport.

[61]  Peter J. Lang,et al.  Parallel amygdala and inferotemporal activation reflect emotional intensity and fear relevance , 2005, NeuroImage.

[62]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[63]  Anthony J. Rissling,et al.  Under what conditions can human affective conditioning occur without contingency awareness? Test of the evaluative conditioning paradigm. , 2007, Emotion.

[64]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[65]  Markus Junghöfer,et al.  The categorization of natural scenes: Brain attention networks revealed by dense sensor ERPs , 2006, NeuroImage.

[66]  Luiz Pessoa,et al.  Affective Learning Enhances Visual Detection and Responses in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[67]  Richard J Davidson,et al.  Spatio-temporal dynamics of brain mechanisms in aversive classical conditioning: high-density event-related potential and brain electrical tomography analyses , 2003, Neuropsychologia.

[68]  L. Huber,et al.  Selective Imitation in Domestic Dogs , 2007, Current Biology.

[69]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[70]  Marcia Grabowecky,et al.  Escape from linear time: Prefrontal cortex and conscious experience , 1995 .

[71]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[72]  N. Costes,et al.  Emotional Responses to Pleasant and Unpleasant Olfactory, Visual, and Auditory Stimuli: a Positron Emission Tomography Study , 2000, The Journal of Neuroscience.

[73]  Karl J. Friston,et al.  Academic Software Applications for Electromagnetic Brain Mapping Using MEG and EEG , 2011, Comput. Intell. Neurosci..

[74]  J. Kissler,et al.  Buzzwords , 2007, Psychological science.

[75]  Joseph E LeDoux,et al.  Differential contribution of dorsal and ventral medial prefrontal cortex to the acquisition and extinction of conditioned fear in rats. , 1995, Behavioral neuroscience.

[76]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[77]  S. Hillyard,et al.  Electrical Signs of Selective Attention in the Human Brain , 1973, Science.

[78]  P. Lovibond,et al.  Awareness is necessary for differential trace and delay eyeblink conditioning in humans , 2011, Biological Psychology.

[79]  Jennifer S. Beer,et al.  Prefrontal involvement in the regulation of emotion: convergence of rat and human studies , 2006, Current Opinion in Neurobiology.

[80]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[81]  R. Adolphs Neural systems for recognizing emotion , 2002, Current Opinion in Neurobiology.

[82]  F. Bloom,et al.  Modulation of early sensory processing in human auditory cortex during auditory selective attention. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[83]  Christopher K. Kovach,et al.  Rapid Interactions between the Ventral Visual Stream and Emotion-Related Structures Rely on a Two-Pathway Architecture , 2008, The Journal of Neuroscience.

[84]  M. Bradley,et al.  Emotion, Motivation, and Anxiety: Brain Mechanisms and Psychophysiology the Motivational Organization of Emotion Patterns of Human Emotion Emotion and Perception the Psychophysiology of Picture Processing Neural Imaging: Motivation in the Visual Cortex Motivational Circuits in the Brain , 2022 .

[85]  Anthony A Grace,et al.  A Subpopulation of Neurons in the Medial Prefrontal Cortex Encodes Emotional Learning with Burst and Frequency Codes through a Dopamine D4 Receptor-Dependent Basolateral Amygdala Input , 2005, The Journal of Neuroscience.

[86]  Henning Scheich,et al.  Learning-induced plasticity in animal and human auditory cortex , 2005, Current Opinion in Neurobiology.

[87]  M. Bradley,et al.  Activation of the visual cortex in motivated attention. , 2003, Behavioral neuroscience.

[88]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[89]  Joseph E LeDoux,et al.  Extinction Learning in Humans Role of the Amygdala and vmPFC , 2004, Neuron.

[90]  Norman M. Weinberger,et al.  Rapid development of learning-induced receptive field plasticity in the auditory cortex. , 1993 .

[91]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[92]  D. Amaral,et al.  The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey , 2005, The Journal of comparative neurology.

[93]  Peter Kirsch,et al.  Dissociation of neural responses and skin conductance reactions during fear conditioning with and without awareness of stimulus contingencies , 2006, NeuroImage.

[94]  L Weiskrantz,et al.  Non-conscious recognition of affect in the absence of striate cortex. , 1999, Neuroreport.

[95]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[96]  J. Edeline,et al.  Rapid development of learning-induced receptive field plasticity in the auditory cortex. , 1993, Behavioral neuroscience.

[97]  Jean Bullier,et al.  The Timing of Information Transfer in the Visual System , 1997 .

[98]  Vera Ferrari,et al.  Directed and Motivated Attention during Processing of Natural Scenes , 2008, Journal of Cognitive Neuroscience.

[99]  Andreas Keil,et al.  Motivated attention in emotional picture processing is reflected by activity modulation in cortical attention networks , 2004, NeuroImage.

[100]  S. David,et al.  Auditory attention : focusing the searchlight on sound , 2007 .

[101]  Harald T Schupp,et al.  Affective blindsight: intact fear conditioning to a visual cue in a cortically blind patient. , 2003, Brain : a journal of neurology.

[102]  Asaid Khateb,et al.  Discriminating emotional faces without primary visual cortices involves the right amygdala , 2005, Nature Neuroscience.

[103]  D. Lehmann,et al.  Rapid emotional face processing in the human right and left brain hemispheres: an ERP study. , 1999, Neuroreport.

[104]  M. Mishkin,et al.  Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex , 1999, Nature Neuroscience.

[105]  Christo Pantev,et al.  Emotion-Associated Tones Attract Enhanced Attention at Early Auditory Processing: Magnetoencephalographic Correlates , 2011, The Journal of Neuroscience.

[106]  S. Luck,et al.  Spatio‐temporal dynamics of attention to color: Evidence from human electrophysiology , 1998, Human brain mapping.

[107]  Hans-Jochen Heinze,et al.  Magnetoencephalography (MEG) determined temporal modulation of visual and auditory sensory processing in the context of classical conditioning to faces , 2006, NeuroImage.

[108]  D L Woods,et al.  Lesions of frontal cortex diminish the auditory mismatch negativity. , 1994, Electroencephalography and clinical neurophysiology.

[109]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[110]  D. Vaitl,et al.  Neural, electrodermal and behavioral response patterns in contingency aware and unaware subjects during a picture–picture conditioning paradigm , 2009, Neuroscience.

[111]  Mark H. Johnson Subcortical face processing , 2005, Nature Reviews Neuroscience.

[112]  Jean Régis,et al.  Ultra-Rapid Sensory Responses in the Human Frontal Eye Field Region , 2009, The Journal of Neuroscience.

[113]  F. Di Russo,et al.  Electrophysiological analysis of cortical mechanisms of selective attention to high and low spatial frequencies , 2001, Clinical Neurophysiology.

[114]  Christo Pantev,et al.  Rapid and Highly Resolving: Affective Evaluation of Olfactorily Conditioned Faces , 2012, Journal of Cognitive Neuroscience.

[115]  Margot J. Taylor,et al.  Attention inhibition of early cortical activation to fearful faces , 2010, Brain Research.

[116]  A. Ioannides,et al.  Attention Modulates Earliest Responses in the Primary Auditory and Visual Cortices , 2008, Neuron.

[117]  R. Davidson,et al.  Anterior cingulate activity as a predictor of degree of treatment response in major depression: evidence from brain electrical tomography analysis. , 2001, The American journal of psychiatry.

[118]  Markus Junghöfer,et al.  ElectroMagnetoEncephalography Software: Overview and Integration with Other EEG/MEG Toolboxes , 2011, Comput. Intell. Neurosci..

[119]  L. Pessoa,et al.  Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance , 2010, Nature Reviews Neuroscience.

[120]  S. Mineka,et al.  Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. , 2001, Psychological review.

[121]  L. Nolan,et al.  Biological psychology , 2019, An Introduction to the Psychology of Humor.