Neural correlates of “social gaze” processing in high-functioning autism under systematic variation of gaze duration☆

Direct gaze is a salient nonverbal signal for social interest and the intention to communicate. In particular, the duration of another's direct gaze can modulate our perception of the social meaning of gaze cues. However, both poor eye contact and deficits in social cognitive processing of gaze are specific diagnostic features of autism. Therefore, investigating neural mechanisms of gaze may provide key insights into the neural mechanisms related to autistic symptoms. Employing functional magnetic resonance imaging (fMRI) and a parametric design, we investigated the neural correlates of the influence of gaze direction and gaze duration on person perception in individuals with high-functioning autism (HFA) and a matched control group. For this purpose, dynamically animated faces of virtual characters, displaying averted or direct gaze of different durations (1 s, 2.5 s and 4 s) were evaluated on a four-point likeability scale. Behavioral results revealed that HFA participants showed no significant difference in likeability ratings depending on gaze duration, while the control group rated the virtual characters as increasingly likeable with increasing gaze duration. On the neural level, direct gaze and increasing direct gaze duration recruit regions of the social neural network (SNN) in control participants, indicating the processing of social salience and a perceived communicative intent. In participants with HFA however, regions of the social neural network were more engaged by averted and decreasing amounts of gaze, while the neural response for processing direct gaze in HFA was not suggestive of any social information processing.

[1]  Jean-Luc Anton,et al.  Recruitment of Both the Mirror and the Mentalizing Networks When Observing Social Interactions Depicted by Point-Lights: A Neuroimaging Study , 2011, PloS one.

[2]  E. Cabanis,et al.  The Human Brain: Surface, Three-Dimensional Sectional Anatomy and Mri , 1991 .

[3]  A. Calder,et al.  Neural mechanisms of social attention , 2009, Trends in Cognitive Sciences.

[4]  D. Perrett,et al.  Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness , 2003, Neuropsychologia.

[5]  T. Allison,et al.  Functional anatomy of biological motion perception in posterior temporal cortex: an FMRI study of eye, mouth and hand movements. , 2005, Cerebral cortex.

[6]  R. Saxe,et al.  Making sense of another mind: The role of the right temporo-parietal junction , 2005, Neuropsychologia.

[7]  Michael C. Frank,et al.  Eye-movements reveal attention to social information in autism spectrum disorder , 2009, Neuropsychologia.

[8]  G. Bente,et al.  Effects of simulated gaze on social presence, person perception and personality attribution in avatar-mediated communication. , 2007 .

[9]  Jason P. Mitchell Activity in right temporo-parietal junction is not selective for theory-of-mind. , 2008, Cerebral cortex.

[10]  C. Schmidt,et al.  Partially segregated neural networks for spatial and contextual memory in virtual navigation , 2008, Hippocampus.

[11]  Jari K. Hietanen,et al.  Seeing direct and averted gaze activates the approach–avoidance motivational brain systems , 2008, Neuropsychologia.

[12]  John T. Serences,et al.  A comparison of methods for characterizing the event-related BOLD timeseries in rapid fMRI , 2004, NeuroImage.

[13]  Nathalie Boddaert,et al.  Autism, the superior temporal sulcus and social perception , 2006, Trends in Neurosciences.

[14]  K. Paller,et al.  Brain networks for analyzing eye gaze. , 2003, Brain research. Cognitive brain research.

[15]  Shaun R. Patel,et al.  Human Dorsal Anterior Cingulate Cortex Neurons Mediate Ongoing Behavioral Adaptation , 2012, Nature.

[16]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[17]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[18]  Brent L. Hughes,et al.  Medial orbitofrontal cortex is associated with shifting decision thresholds in self-serving cognition , 2012, NeuroImage.

[19]  R. Fukuda,et al.  fMRI study of recognition of facial expressions in high-functioning autistic patients , 2003, Neuroreport.

[20]  E. Bullmore,et al.  Social intelligence in the normal and autistic brain: an fMRI study , 1999, The European journal of neuroscience.

[21]  Roxane J. Itier,et al.  Neural bases of eye and gaze processing: The core of social cognition , 2009, Neuroscience & Biobehavioral Reviews.

[22]  Patrik Vuilleumier,et al.  Self-relevance processing in the human amygdala: gaze direction, facial expression, and emotion intensity. , 2009, Emotion.

[23]  Aina Puce,et al.  Occipitotemporal Activity Elicited by Viewing Eye Movements: A Magnetoencephalographic Study , 2001, NeuroImage.

[24]  C. Kleinke Gaze and eye contact: a research review. , 1986, Psychological bulletin.

[25]  H. Sackeim,et al.  Parietal cortex and representation of the mental Self. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[26]  D. Perrett,et al.  Being the target of another’s emotion: a PET study , 2003, Neuropsychologia.

[27]  Patrik Vuilleumier,et al.  Integration of gaze direction and facial expression in patients with unilateral amygdala damage. , 2010, Brain : a journal of neurology.

[28]  M. Kringelbach The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[29]  Alan Kingstone,et al.  Covert and overt orienting to gaze direction cues and the effects of fixation offset , 2003, Neuroreport.

[30]  D. Povinelli,et al.  Mindblindness. An Essay on Autism and Theory of Mind Simon Baron-Cohen 1995 , 1996, Trends in Neurosciences.

[31]  Sylvia M. J. Hains,et al.  Look at me: five-month-old infants' sensitivity to very small deviations in eye-gaze during social interactions , 1998 .

[32]  W. Penny,et al.  Random-Effects Analysis , 2002 .

[33]  Mark H. Johnson,et al.  Neural Correlates of Eye-Gaze Detection in Young Children with Autism , 2005, Cortex.

[34]  T. Allison,et al.  Brain activation evoked by perception of gaze shifts: the influence of context , 2003, Neuropsychologia.

[35]  M. Clark,et al.  The Difference between Communal and Exchange Relationships: What it is and is Not , 1993 .

[36]  R. Adolphs,et al.  The social brain: neural basis of social knowledge. , 2009, Annual review of psychology.

[37]  Wolfgang Satzger,et al.  Liefern HAWIE-R, WST und MWT-B vergleichbare IQ-Werte? , 2002 .

[38]  G. Triebig,et al.  Multiple choice vocabulary test MWT as a valid and short test to estimate premorbid intelligence , 1995, Acta neurologica Scandinavica.

[39]  Patrik Vuilleumier,et al.  Processing social aspects of human gaze: A combined fMRI-DTI study , 2011, NeuroImage.

[40]  C. Frith,et al.  Social interaction modifies neural response to gaze shifts. , 2007, Social cognitive and affective neuroscience.

[41]  Mark H. Johnson,et al.  The eye contact effect: mechanisms and development , 2009, Trends in Cognitive Sciences.

[42]  Nadim Joni Shah,et al.  Minds Made for Sharing: Initiating Joint Attention Recruits Reward-related Neurocircuitry , 2010, Journal of Cognitive Neuroscience.

[43]  Simon B Eickhoff,et al.  Shall we do this together? Social gaze influences action control in a comparison group, but not in individuals with high-functioning autism , 2012, Autism : the international journal of research and practice.

[44]  Frank Van Overwalle,et al.  Understanding others' actions and goals by mirror and mentalizing systems: A meta-analysis , 2009, NeuroImage.

[45]  Ronald J. Pelias,et al.  Intensity , 1973, Definitions.

[46]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[47]  E. Rolls,et al.  The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology , 2004, Progress in Neurobiology.

[48]  S. Baron-Cohen,et al.  The "Reading the Mind in the Eyes" Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[49]  D. Muir,et al.  Gaze-following : its development and significance , 2007 .

[50]  Shiri Einav,et al.  Children's use of the temporal dimension of gaze for inferring preference. , 2006, Developmental psychology.

[51]  Nadim Joni Shah,et al.  Duration matters: Dissociating neural correlates of detection and evaluation of social gaze , 2009, NeuroImage.

[52]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[53]  Sterling C. Johnson,et al.  Neural correlates of self-reflection. , 2002, Brain : a journal of neurology.

[54]  M. Argyle,et al.  EYE-CONTACT, DISTANCE AND AFFILIATION. , 1965, Sociometry.

[55]  Johan D. Carlin,et al.  A Head View-Invariant Representation of Gaze Direction in Anterior Superior Temporal Sulcus , 2011, Current Biology.

[56]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[57]  C. Frith The social brain? , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[58]  H. Duvernoy,et al.  The Human Brain: Surface, Three-Dimensional Sectional Anatomy with MRI, and Blood Supply , 1999 .

[59]  Kai Vogeley,et al.  "Artificial humans": Psychology and neuroscience perspectives on embodiment and nonverbal communication , 2010, Neural Networks.

[60]  Kim M. Dalton,et al.  Gaze fixation and the neural circuitry of face processing in autism , 2005, Nature Neuroscience.

[61]  David I. Perrett,et al.  An fMRI study of joint attention experience , 2005, NeuroImage.

[62]  C. Frith,et al.  Reading the mind in cartoons and stories: an fMRI study of ‘theory of mind’ in verbal and nonverbal tasks , 2000, Neuropsychologia.

[63]  N. Minshew,et al.  Cortical patterns of category‐selective activation for faces, places and objects in adults with autism , 2008, Autism research : official journal of the International Society for Autism Research.

[64]  R. Saxe,et al.  What gets the attention of the temporo-parietal junction? An fMRI investigation of attention and theory of mind , 2010, Neuropsychologia.

[65]  Wolfgang Grodd,et al.  Cerebral representation of non-verbal emotional perception: fMRI reveals audiovisual integration area between voice- and face-sensitive regions in the superior temporal sulcus , 2009, Neuropsychologia.

[66]  Charles I. Brooks,et al.  Effects of duration of eye contact on judgments of personality characteristics. , 1986 .

[67]  E. Maguire,et al.  Patterns of hippocampal‐cortical interaction dissociate temporal lobe memory subsystems , 2000, Hippocampus.

[68]  K. Vogeley,et al.  A Matter of Words: Impact of Verbal and Nonverbal Information on Impression Formation in High-Functioning Autism. , 2011 .

[69]  M. V. von Grünau,et al.  The Detection of Gaze Direction: A Stare-In-The-Crowd Effect , 1995, Perception.

[70]  Olivier Pascalis,et al.  A Study of Impaired Judgment of Eye-Gaze Direction and Related Face-Processing Deficits in Autism Spectrum Disorders , 2006, Perception.

[71]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[72]  G. McCarthy,et al.  When Strangers Pass , 2004, Psychological science.

[73]  K. Vogeley,et al.  [Autism spectrum disorders in adulthood: clinical and neuropsychological findings of Aspergers syndrome diagnosed late in life]. , 2011, Fortschritte der Neurologie-Psychiatrie.

[74]  James B. Rowe,et al.  Direct Gaze Elicits Atypical Activation of the Theory-of-Mind Network in Autism Spectrum Conditions , 2013, Cerebral cortex.

[75]  G. Fink,et al.  Being with virtual others: Neural correlates of social interaction , 2006, Neuropsychologia.

[76]  J M Droney,et al.  Attributions of self-esteem as a function of duration of eye contact. , 1993, The Journal of social psychology.

[77]  D. Ariely,et al.  Beautiful Faces Have Variable Reward Value fMRI and Behavioral Evidence , 2001, Neuron.

[78]  Mark H. Johnson,et al.  Atypical eye contact in autism: Models, mechanisms and development , 2009, Neuroscience & Biobehavioral Reviews.

[79]  M. D. Rutherford,et al.  Scan Path Differences and Similarities During Emotion Perception in those With and Without Autism Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[80]  Richard S. J. Frackowiak,et al.  Other minds in the brain: a functional imaging study of “theory of mind” in story comprehension , 1995, Cognition.

[81]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[82]  Antony J. Chapman,et al.  EEG correlates of eye contact and interpersonal distance , 1975, Biological Psychology.

[83]  M. Argyle,et al.  The meaning of five patterns of gaze , 1974 .

[84]  Natacha S. Santos,et al.  Investigation of Mentalizing and Visuospatial Perspective Taking for Self and Other in Asperger Syndrome , 2010, Journal of autism and developmental disorders.

[85]  Karl J. Friston,et al.  Detecting Activations in PET and fMRI: Levels of Inference and Power , 1996, NeuroImage.

[86]  C. Kleinke,et al.  Eye Contact, Gender, and Personality Judgments , 1991 .

[87]  Edward T. Bullmore,et al.  Specialization of right temporo-parietal junction for mentalizing and its relation to social impairments in autism , 2011, NeuroImage.

[88]  Mark H. Johnson,et al.  Eye contact detection in humans from birth , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[89]  Jason P. Mitchell,et al.  A neural mechanism of first impressions , 2009, Nature Neuroscience.

[90]  A. Little,et al.  Integrating Gaze Direction and Expression in Preferences for Attractive Faces , 2006, Psychological science.

[91]  Toshikazu Hasegawa,et al.  Deviant gaze processing in children with autism: an ERP study , 2005, Neuropsychologia.

[92]  H. Critchley,et al.  The functional neuroanatomy of social behaviour: changes in cerebral blood flow when people with autistic disorder process facial expressions. , 2000, Brain : a journal of neurology.

[93]  Nick Donnelly,et al.  It’s All in the Eyes: Subcortical and Cortical Activation during Grotesqueness Perception in Autism , 2013, PloS one.

[94]  Gregory McCarthy,et al.  Taking an “intentional stance” on eye-gaze shifts: A functional neuroimaging study of social perception in children , 2005, NeuroImage.

[95]  T. Paus,et al.  Cortical regions involved in eye movements, shifts of attention, and gaze perception , 2005, Human brain mapping.

[96]  E. Bullmore,et al.  The role of MT+/V5 during biological motion perception in Asperger Syndrome: An fMRI study , 2007 .

[97]  C. Schmitz,et al.  From Action to Interaction: Exploring the Contribution of Body Motion Cues to Social Understanding in Typical Development and in Autism Spectrum Disorders , 2013, Journal of autism and developmental disorders.

[98]  A. Young,et al.  Reading the mind from eye gaze , 2002, Neuropsychologia.

[99]  Nouchine Hadjikhani,et al.  Abnormal activation of the social brain during face perception in autism , 2007, Human brain mapping.

[100]  Aina Puce,et al.  Human MT/V5 activity on viewing eye gaze changes in others: A magnetoencephalographic study , 2006, Brain Research.

[101]  K. Amunts,et al.  Human V5/MT+: comparison of functional and cytoarchitectonic data , 2005, Anatomy and Embryology.

[102]  Nicole David,et al.  Impairments in multisensory processing are not universal to the autism spectrum: no evidence for crossmodal priming deficits in Asperger syndrome , 2011, Autism research : official journal of the International Society for Autism Research.

[103]  Evelyn C. Ferstl,et al.  The Anterior Frontomedian Cortex and Evaluative Judgment: An fMRI Study , 2002, NeuroImage.

[104]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[105]  A. Senju,et al.  Eye contact does not facilitate detection in children with autism , 2003, Cognition.

[106]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[107]  J. Buitelaar,et al.  Attachment and Social Withdrawal in Autism: Hypotheses and Findings , 1995 .

[108]  Nicole C. Krämer,et al.  Virtual Gaze. A Pilot Study on the Effects of Computer Simulated Gaze in Avatar-Based Conversations , 2007, HCI.

[109]  Mary E Stewart,et al.  Presentation of depression in autism and Asperger syndrome , 2006, Autism : the international journal of research and practice.

[110]  C. Frith,et al.  “Hey John”: Signals Conveying Communicative Intention toward the Self Activate Brain Regions Associated with “Mentalizing,” Regardless of Modality , 2003, The Journal of Neuroscience.

[111]  F. Volkmar,et al.  Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. , 2000, Archives of general psychiatry.

[112]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[113]  J. Price,et al.  Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys , 1995, The Journal of comparative neurology.

[114]  E. Courchesne,et al.  Face processing occurs outside the fusiform 'face area' in autism: evidence from functional MRI. , 2001, Brain : a journal of neurology.

[115]  Matthew D. Lieberman,et al.  The self and social perception: Three kinds of questions in social cognitive neuroscience. , 2005 .

[116]  N. George,et al.  When eye creates the contact! ERP evidence for early dissociation between direct and averted gaze motion processing , 2007, Neuropsychologia.

[117]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[118]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[119]  J. O'Doherty,et al.  Temporal isolation of neural processes underlying face preference decisions , 2007, Proceedings of the National Academy of Sciences.

[120]  Kate Nation,et al.  Sensitivity to eye gaze in autism: Is it normal? Is it automatic? Is it social? , 2008, Development and Psychopathology.

[121]  G. Fink,et al.  Cerebral Representation of One’s Own Past: Neural Networks Involved in Autobiographical Memory , 1996, The Journal of Neuroscience.

[122]  P. Ruby,et al.  What is self-specific? Theoretical investigation and critical review of neuroimaging results. , 2009, Psychological review.

[123]  Kai Vogeley,et al.  Contextualising culture and social cognition , 2009, Trends in Cognitive Sciences.

[124]  Kai Vogeley,et al.  Corpus callosum size in adults with high-functioning autism and the relevance of gender , 2010, Psychiatry Research: Neuroimaging.

[125]  Nicole C. Krämer,et al.  Transcript-based computer animation of movement: Evaluating a new tool for nonverbal behavior research , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[126]  Kai Vogeley,et al.  Autismus-Spektrum-Störungen im Erwachsenenalter: klinische und neuropsychologische Befunde spätdiagnostizierter Asperger-Syndrome , 2011 .

[127]  Yukiko Kikuchi,et al.  Is anyone looking at me? Direct gaze detection in children with and without autism , 2008, Brain and Cognition.

[128]  G. McCarthy,et al.  Neural basis of eye gaze processing deficits in autism. , 2005, Brain : a journal of neurology.

[129]  Alumit Ishai,et al.  Face Perception Is Modulated by Sexual Preference , 2006, Current Biology.

[130]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[131]  Nikolaus F. Troje,et al.  Perception of biological motion in autism spectrum disorders , 2008, Neuropsychologia.

[132]  K. Zilles,et al.  Mind Reading: Neural Mechanisms of Theory of Mind and Self-Perspective , 2001, NeuroImage.

[133]  O. Tzeng,et al.  Right temporoparietal junction and attentional reorienting , 2013, Human brain mapping.

[134]  Luca Turella,et al.  Observing social interactions: The effect of gaze , 2008, Social neuroscience.

[135]  Danielle Z. Bolling,et al.  Brain Mechanisms for Processing Direct and Averted Gaze in Individuals with Autism , 2011, Journal of autism and developmental disorders.

[136]  Christopher F. Chabris,et al.  Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces , 2004, NeuroImage.

[137]  W. D. Penny,et al.  Random-Effects Analysis , 2002 .

[138]  Ami Klin,et al.  [Autism and Asperger syndrome: an overview]. , 2006, Revista brasileira de psiquiatria.

[139]  Brian J Scholl,et al.  Dissociating the Detection of Intentionality from Animacy in the Right Posterior Superior Temporal Sulcus , 2012, The Journal of Neuroscience.

[140]  C. Frith,et al.  Functional imaging of ‘theory of mind’ , 2003, Trends in Cognitive Sciences.

[141]  L. Bach,et al.  Children's use of looking behavior as a cue to detect another's goal. , 1998, Child development.

[142]  Torbjörn Falkmer,et al.  Fixation Identification in Centroid versus Start-Point Modes Using Eye-Tracking Data , 2008, Perceptual and motor skills.

[143]  Lauri Nummenmaa,et al.  Visuospatial attention shifts by gaze and arrow cues: An ERP study , 2008, Brain Research.

[144]  S. Baron-Cohen,et al.  Is There a "Language of the Eyes"? Evidence from Normal Adults, and Adults with Autism or Asperger Syndrome , 1997 .

[145]  G. Glover,et al.  Dissociable Intrinsic Connectivity Networks for Salience Processing and Executive Control , 2007, The Journal of Neuroscience.

[146]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[147]  Kai Vogeley,et al.  Responses to Nonverbal Behaviour of Dynamic Virtual Characters in High-Functioning Autism , 2010, Journal of autism and developmental disorders.

[148]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[149]  Christian Scheel,et al.  Imaging derived cortical thickness reduction in high-functioning autism: Key regions and temporal slope , 2011, NeuroImage.

[150]  A. Kingstone,et al.  Eyes are special but not for everyone: the case of autism. , 2005, Brain research. Cognitive brain research.

[151]  Nicole C. Krämer,et al.  Computer Animated Movement and Person Perception: Methodological Advances in Nonverbal Behavior Research , 2001 .

[152]  E. Schopler,et al.  Asperger Syndrome or High-Functioning Autism? , 2012 .