Coding of saliency by ensemble bursting in the amygdala of primates

Salient parts of a visual scene attract longer and earlier fixations of the eyes. Saliency is driven by bottom-up (image dependent) factors and top-down factors such as behavioral relevance, goals, and expertise. It is currently assumed that a saliency map defining eye fixation priorities is stored in neural structures that remain to be determined. Lesion studies support a role for the amygdala in detecting saliency. Here we show that neurons in the amygdala of primates fire differentially when the eyes approach to or fixate behaviorally relevant parts of visual scenes. Ensemble bursting in the amygdala accurately predicts main fixations during the free-viewing of natural images. However, fixation prediction is significantly better for faces - where a bottom-up computational saliency model fails - compared to unfamiliar objects and landscapes. On this basis we propose the amygdala as a locus for a saliency map and ensemble bursting as a saliency coding mechanism.

[1]  H. Ursin,et al.  KAADA BR: Subcortical structures mediating the attention response induced by amygdala stimulation. , 1960, Experimental neurology.

[2]  Elmer S. West From the U. S. A. , 1965 .

[3]  K. Pribram,et al.  The effect of resections of the inferotemporal cortex or the amygdala on visual orienting and habituation. , 1972, Neuropsychologia.

[4]  R. Desimone,et al.  Visual areas in the temporal cortex of the macaque , 1979, Brain Research.

[5]  Mark D. Underwood,et al.  Autonomic and somatomotor effects of amygdala central N. stimulation in awake rabbits , 1983, Physiology & Behavior.

[6]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TE and TEO with medial temporal- lobe structures in infant and adult monkeys , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  L. Squire,et al.  Independence of memory functions and emotional behavior: Separate contributions of the hippocampal formation and the amygdala , 1991, Hippocampus.

[8]  Ralph E. Hurd,et al.  A procedure for using proton magnetic resonance imaging to determine stereotaxic coordinates of the monkey's brain , 1991, Journal of Neuroscience Methods.

[9]  M. Gallagher,et al.  The amygdala complex: multiple roles in associative learning and attention. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[10]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[11]  P. Holland,et al.  The Role of an Amygdalo-Nigrostriatal Pathway in Associative Learning , 1997, The Journal of Neuroscience.

[12]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[13]  T Moore,et al.  Shape representations and visual guidance of saccadic eye movements. , 1999, Science.

[14]  J. Piven,et al.  Abnormal Processing of Social Information from Faces in Autism , 2001, Journal of Cognitive Neuroscience.

[15]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[16]  H. Barbas,et al.  Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey , 2002, Neuroscience.

[17]  C. Grady,et al.  Studies of Altered Social Cognition in Neuropsychiatric Disorders Using Functional Neuroimaging , 2002, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[18]  S. Taylor,et al.  Extended Amygdala and Emotional Salience: A PET Activation Study of Positive and Negative Affect , 2003, Neuropsychopharmacology.

[19]  D. Amaral,et al.  Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey , 2003, Neuroscience.

[20]  G. Alheid Extended Amygdala and Basal Forebrain , 2003, Annals of the New York Academy of Sciences.

[21]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[22]  Jeffrey D. Schall,et al.  Relationship of presaccadic activity in frontal eye field and supplementary eye field to saccade initiation in macaque: Poisson spike train analysis , 2004, Experimental Brain Research.

[23]  E. Gordon,et al.  Face to face: visual scanpath evidence for abnormal processing of facial expressions in social phobia , 2004, Psychiatry Research.

[24]  S. Baron-Cohen Autism: research into causes and intervention , 2004, Pediatric rehabilitation.

[25]  M. Tovée,et al.  The responses of neurons in the temporal cortex of primates, and face identification and detection , 1994, Experimental Brain Research.

[26]  J. Frank,et al.  Magnetic resonance imaging of the rhesus monkey brain: use for stereotactic neurosurgery , 2004, Experimental Brain Research.

[27]  M. Young,et al.  Longer fixation duration while viewing face images , 2006, Experimental Brain Research.

[28]  Gilles Pourtois,et al.  Emotion and attention interactions in social cognition: Brain regions involved in processing anger prosody , 2005, NeuroImage.

[29]  P. Schyns,et al.  A mechanism for impaired fear recognition after amygdala damage , 2005, Nature.

[30]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[31]  D. Amaral,et al.  Synaptic organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkey , 2005, The Journal of comparative neurology.

[32]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[33]  K. Guo Initial fixation placement in face images is driven by top–down guidance , 2007, Experimental Brain Research.

[34]  K M Gothard,et al.  Neural responses to facial expression and face identity in the monkey amygdala. , 2007, Journal of neurophysiology.

[35]  Nikos K. Logothetis,et al.  Facial-Expression and Gaze-Selective Responses in the Monkey Amygdala , 2007, Current Biology.

[36]  Satoshi Umeda,et al.  Unilateral amygdala lesions hamper attentional orienting triggered by gaze direction. , 2007, Cerebral cortex.

[37]  J. Piven,et al.  Orienting to social stimuli differentiates social cognitive impairment in autism and schizophrenia , 2007, Neuropsychologia.

[38]  Ralph Adolphs,et al.  Fear, faces, and the human amygdala , 2008, Current Opinion in Neurobiology.

[39]  M. Nicolelis,et al.  Neuronal Ensemble Bursting in the Basal Forebrain Encodes Salience Irrespective of Valence , 2008, Neuron.

[40]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  K. Gothard,et al.  Response Characteristics of Basolateral and Centromedial Neurons in the Primate Amygdala , 2010, The Journal of Neuroscience.

[42]  R. Adolphs,et al.  Single-Unit Responses Selective for Whole Faces in the Human Amygdala , 2011, Current Biology.

[43]  L. Itti,et al.  Mechanisms of top-down attention , 2011, Trends in Neurosciences.

[44]  K. Gothard,et al.  Videos of conspecifics elicit interactive looking patterns and facial expressions in monkeys. , 2011, Behavioral neuroscience.

[45]  R. Grave de Peralta Menendez,et al.  Coding of saliency by ensemble bursting in the amygdala of primates , 2012, Frontiers in behavioral neuroscience.

[46]  M. Ashburner,et al.  Shape Representations and Visual Guidance of Saccadic Eye Movements , 2022 .