Neural mechanisms underlying conscious and unconscious attentional shifts triggered by eye gaze

Behavioral studies have shown that eye gaze triggers attentional shifts both with and without conscious awareness. However, the neural substrates of conscious and unconscious attentional shifts triggered by eye gaze remain unclear. To investigate this issue, we measured brain activity using event-related functional magnetic resonance imaging while participants observed averted or straight eye-gaze cues presented supraliminally or subliminally in the central visual field and then localized a subsequent target in the peripheral visual field. Reaction times for localizing the targets were shorter under both supraliminal and subliminal conditions when eye-gaze cues were directionally congruent with the target locations than when they were directionally neutral. Conjunction analyses revealed that a bilateral cortical network, including the middle temporal gyri, inferior parietal lobules, anterior cingulate cortices, and superior and middle frontal gyri, was activated more in response to averted eyes than to straight eyes under both supraliminal and subliminal conditions. Interaction analyses revealed that the right inferior parietal lobule was specifically active when participants viewed averted eyes relative to straight eyes under the supraliminal condition; the bilateral subcortical regions, including the superior colliculus and amygdala, and the middle temporal and inferior frontal gyri in the right hemisphere were activated in response to averted versus straight eyes under the subliminal condition. These results suggest commonalities and differences in the neural mechanisms underlying conscious and unconscious attentional shifts triggered by eye gaze.

[1]  William A. Cunningham,et al.  Type I and Type II error concerns in fMRI research: re-balancing the scale. , 2009, Social cognitive and affective neuroscience.

[2]  Kevin A. Pelphrey,et al.  Face processing without awareness in the right fusiform gyrus , 2007, Neuropsychologia.

[3]  Andrew D. Engell,et al.  Facial expression and gaze-direction in human superior temporal sulcus , 2007, Neuropsychologia.

[4]  R. Rafal,et al.  Neural fate of seen and unseen faces in visuospatial neglect: A combined event-related functional MRI and event-related potential study , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[5]  G. Pourtois,et al.  Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging , 2007, Neuropsychologia.

[6]  Marco Iacoboni,et al.  The neural correlates of social attention: automatic orienting to social and nonsocial cues , 2009, Psychological research.

[7]  O. Tzeng,et al.  Posterior parietal cortex mediates encoding and maintenance processes in change blindness , 2010, Neuropsychologia.

[8]  Sakiko Yoshikawa,et al.  Commonalities in the neural mechanisms underlying automatic attentional shifts by gaze, gestures, and symbols , 2009, NeuroImage.

[9]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[10]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[11]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[12]  G. Paxinos,et al.  Atlas of the Human Brain , 2000 .

[13]  C. Frith,et al.  Neural correlates of change detection and change blindness , 2001, Nature Neuroscience.

[14]  Michael J. Martinez,et al.  Bias between MNI and Talairach coordinates analyzed using the ICBM‐152 brain template , 2007, Human brain mapping.

[15]  G. McCarthy,et al.  When Strangers Pass , 2004, Psychological science.

[16]  C. Koch,et al.  Attention and consciousness: two distinct brain processes , 2007, Trends in Cognitive Sciences.

[17]  T Allison,et al.  ERPS EVOKED BY VIEWING FACIAL MOVEMENTS , 2000, Cognitive neuropsychology.

[18]  L. Weiskrantz,et al.  Differential extrageniculostriate and amygdala responses to presentation of emotional faces in a cortically blind field. , 2001, Brain : a journal of neurology.

[19]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[20]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[21]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[22]  Edward T. Bullmore,et al.  Differential neural responses to overt and covert presentations of facial expressions of fear and disgust , 2000, NeuroImage.

[23]  Karl J. Friston,et al.  To Smooth or Not to Smooth? Bias and Efficiency in fMRI Time-Series Analysis , 2000, NeuroImage.

[24]  Karl J. Friston,et al.  Stochastic Designs in Event-Related fMRI , 1999, NeuroImage.

[25]  T. Allison,et al.  Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. , 1999, Cerebral cortex.

[26]  N. George,et al.  When eye creates the contact! ERP evidence for early dissociation between direct and averted gaze motion processing , 2007, Neuropsychologia.

[27]  T. Allison,et al.  Brain activation evoked by perception of gaze shifts: the influence of context , 2003, Neuropsychologia.

[28]  Alexis Hervais-Adelman,et al.  Amygdala Activation for Eye Contact Despite Complete Cortical Blindness , 2013, The Journal of Neuroscience.

[29]  Satoshi Umeda,et al.  Unilateral amygdala lesions hamper attentional orienting triggered by gaze direction. , 2007, Cerebral cortex.

[30]  T. Kochiyama,et al.  Rapid Amygdala Gamma Oscillations in Response to Eye Gaze , 2011, PloS one.

[31]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[32]  S. Rauch,et al.  Masked Presentations of Emotional Facial Expressions Modulate Amygdala Activity without Explicit Knowledge , 1998, The Journal of Neuroscience.

[33]  Shan Xu,et al.  Gaze-induced joint attention persists under high perceptual load and does not depend on awareness , 2011, Vision Research.

[34]  Stephen M. Rao,et al.  Neural Basis of Endogenous and Exogenous Spatial Orienting: A Functional MRI Study , 1999, Journal of Cognitive Neuroscience.

[35]  P Vuilleumier,et al.  Neural response to emotional faces with and without awareness: event-related fMRI in a parietal patient with visual extinction and spatial neglect , 2002, Neuropsychologia.

[36]  W. Sato,et al.  Involvement of medial temporal structures in reflexive attentional shift by gaze. , 2008, Social cognitive and affective neuroscience.

[37]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[38]  Bradley Goodyear,et al.  Reduced Intrinsic Connectivity of Amygdala in Adults with Major Depressive Disorder , 2014, Front. Psychiatry.

[39]  Effective processing of masked eye gaze requires volitional control , 2012, Experimental Brain Research.

[40]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[41]  Phoebe E. Bailey,et al.  Age differences in conscious versus subconscious social perception: the influence of face age and valence on gaze following. , 2014, Psychology and aging.

[42]  F. Happé,et al.  Meta-analysis of gray matter abnormalities in autism spectrum disorder: should Asperger disorder be subsumed under a broader umbrella of autistic spectrum disorder? , 2011, Archives of general psychiatry.

[43]  Shoji Itakura,et al.  The Role of the Right Prefrontal Cortex in Self-evaluation of the Face: A Functional Magnetic Resonance Imaging Study , 2008, Journal of Cognitive Neuroscience.

[44]  Sakiko Yoshikawa,et al.  Time course of superior temporal sulcus activity in response to eye gaze: a combined fMRI and MEG study. , 2008, Social cognitive and affective neuroscience.

[45]  Sheng He,et al.  Cortical Responses to Invisible Faces: Dissociating Subsystems for Facial-Information Processing , 2006, Current Biology.

[46]  Sakiko Yoshikawa,et al.  The amygdala processes the emotional significance of facial expressions: an fMRI investigation using the interaction between expression and face direction , 2004, NeuroImage.

[47]  W. Sato,et al.  Impairment of unconscious, but not conscious, gaze-triggered attention orienting in Asperger's disorder , 2010 .

[48]  Jeffrey S. Maxwell,et al.  Human Amygdala Responsivity to Masked Fearful Eye Whites , 2004, Science.

[49]  G. Chen,et al.  The amygdala is involved in affective priming effect for fearful faces , 2012, Brain and Cognition.

[50]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[51]  Lauri Nummenmaa,et al.  Visuospatial attention shifts by gaze and arrow cues: An ERP study , 2008, Brain Research.

[52]  Huafu Chen,et al.  Neural mechanism of unconscious perception of surprised facial expression , 2010, NeuroImage.

[53]  J. Decety,et al.  Brain Regions Involved in the Perception of Gaze: A PET Study , 1998, NeuroImage.

[54]  Alan Kingstone,et al.  Brain Responses to Biological Relevance , 2008, Journal of Cognitive Neuroscience.

[55]  Aina Puce,et al.  Occipitotemporal Activity Elicited by Viewing Eye Movements: A Magnetoencephalographic Study , 2001, NeuroImage.

[56]  L. Pessoa,et al.  Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance , 2010, Nature Reviews Neuroscience.

[57]  Jon Driver,et al.  Seen Gaze-Direction Modulates Fusiform Activity and Its Coupling with Other Brain Areas during Face Processing , 2001, NeuroImage.

[58]  N. Logothetis,et al.  Disrupting Parietal Function Prolongs Dominance Durations in Binocular Rivalry , 2010, Current Biology.

[59]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[60]  J. Theeuwes,et al.  Unconscious attentional orienting to exogenous cues: A review of the literature. , 2010, Acta psychologica.

[61]  J. Drivera,et al.  Neural response to emotional faces with and without awareness : event-related fMRI in a parietal patient with visual extinction and spatial neglect , 2002 .

[62]  Alan Kingstone,et al.  The eyes have it!: An fMRI investigation , 2004, Brain and Cognition.

[63]  P. Avanzini,et al.  Human cortical activity evoked by gaze shift observation: An intracranial EEG study , 2014, Human brain mapping.

[64]  P. Ekman.  Pictures of Facial Affect , 1976 .

[65]  Maurizio Corbetta,et al.  Dorsal and Ventral Attention Systems Underlie Social and Symbolic Cueing , 2014, Journal of Cognitive Neuroscience.

[66]  E. Macaluso,et al.  Mapping reflexive shifts of attention in eye‐centered and hand‐centered coordinate systems , 2012, Human brain mapping.

[67]  Sabine Kastner,et al.  Visual responses of the human superior colliculus: a high-resolution functional magnetic resonance imaging study. , 2005, Journal of neurophysiology.

[68]  T. Kochiyama,et al.  Commonalities and differences in the spatiotemporal neural dynamics associated with automatic attentional shifts induced by gaze and arrows , 2014, Neuroscience Research.

[69]  Vincent Walsh,et al.  Right parietal cortex plays a critical role in change blindness. , 2006, Cerebral cortex.

[70]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[71]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Applications , 2002, NeuroImage.

[72]  Sameer A Sheth,et al.  Deep brain stimulation for severe autism: from pathophysiology to procedure. , 2015, Neurosurgical focus.

[73]  Riitta Parkkola,et al.  Automatic attention orienting by social and symbolic cues activates different neural networks: An fMRI study , 2006, NeuroImage.

[74]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[75]  T. Paus,et al.  Cortical regions involved in eye movements, shifts of attention, and gaze perception , 2005, Human brain mapping.

[76]  A. Young,et al.  Reading the mind from eye gaze , 2002, Neuropsychologia.

[77]  Andrew D. Engell,et al.  Differential activation of frontoparietal attention networks by social and symbolic spatial cues , 2010, Social cognitive and affective neuroscience.

[78]  T. Kochiyama,et al.  Rapid and multiple-stage activation of the human amygdala for processing facial signals , 2013, Communicative & integrative biology.

[79]  R J Seitz,et al.  Processing of subliminal facial expressions of emotion: A behavioral and fMRI study , 2013, Social neuroscience.

[80]  M. Posner.  Attention: the mechanisms of consciousness. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[81]  C. Koch,et al.  Continuous flash suppression reduces negative afterimages , 2005, Nature Neuroscience.

[82]  M. Tamietto,et al.  Neural bases of the non-conscious perception of emotional signals , 2010, Nature Reviews Neuroscience.

[83]  Wataru Sato,et al.  Attentional shift by gaze is triggered without awareness , 2007, Experimental Brain Research.

[84]  Satoshi Umeda,et al.  Gaze but not arrows: A dissociative impairment after right superior temporal gyrus damage , 2006, Neuropsychologia.

[85]  Karl J. Friston,et al.  Cognitive Conjunction: A New Approach to Brain Activation Experiments , 1997, NeuroImage.

[86]  K. Paller,et al.  Brain networks for analyzing eye gaze. , 2003, Brain research. Cognitive brain research.

[87]  W. Sato,et al.  Dynamic fearful expressions enhance gaze-triggered attention orienting in high and low anxiety individuals , 2009 .