Seeing things differently: Gaze shapes neural signal during mentalizing according to emotional awareness

Studies on social cognition often use complex visual stimuli to asses neural processes attributed to abilities like "mentalizing" or "Theory of Mind" (ToM). During the processing of these stimuli, eye gaze, however, shapes neural signal patterns. Individual differences in neural operations on social cognition may therefore be obscured if individuals' gaze behavior differs systematically. These obstacles can be overcome by the combined analysis of neural signal and natural viewing behavior. Here, we combined functional magnetic resonance imaging (fMRI) with eye-tracking to examine effects of unconstrained gaze on neural ToM processes in healthy individuals with differing levels of emotional awareness, i.e. alexithymia. First, as previously described for emotional tasks, people with higher alexithymia levels look less at eyes in both ToM and task-free viewing contexts. Further, we find that neural ToM processes are not affected by individual differences in alexithymia per se. Instead, depending on alexithymia levels, gaze on critical stimulus aspects reversely shapes the signal in medial prefrontal cortex (MPFC) and anterior temporoparietal junction (TPJ) as distinct nodes of the ToM system. These results emphasize that natural selective attention affects fMRI patterns well beyond the visual system. Our study implies that, whenever using a task with multiple degrees of freedom in scan paths, ignoring the latter might obscure important conclusions.

[1]  G. Bird,et al.  Theory of Mind Is Not Theory of Emotion: A Cautionary Note on the Reading the Mind in the Eyes Test , 2016, Journal of abnormal psychology.

[2]  K. Honkalampi,et al.  Depression is strongly associated with alexithymia in the general population. , 2000, Journal of psychosomatic research.

[3]  D. Grossi,et al.  Neuropsychological Correlates of Theory of Mind Deficits in Patients With Multiple Sclerosis , 2017, Neuropsychology.

[4]  G. Huston The Hospital Anxiety and Depression Scale. , 1987, The Journal of rheumatology.

[5]  J. Salonen,et al.  Alexithymia and risk of death in middle-aged men. , 1996, Journal of psychosomatic research.

[6]  M. Rushworth,et al.  Connectivity-based subdivisions of the human right "temporoparietal junction area": evidence for different areas participating in different cortical networks. , 2012, Cerebral cortex.

[7]  M. de Zwaan,et al.  [Validation of the German version of the 20-item Toronto Alexithymia Scale in normal persons and psychiatric patients]. , 1996, Psychotherapie, Psychosomatik, medizinische Psychologie.

[8]  E. Fujiwara Looking at the Eyes Interferes With Facial Emotion Recognition in Alexithymia , 2018, Journal of abnormal psychology.

[9]  J. Henderson Gaze Control as Prediction , 2017, Trends in Cognitive Sciences.

[10]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[11]  M. Vandekerckhove,et al.  Implicit and explicit social mentalizing: dual processes driven by a shared neural network , 2013, Front. Hum. Neurosci..

[12]  J. van os,et al.  A Psychometric Evaluation of the Danish Version of the Theory of Mind Storybook for 8–14 Year-Old Children , 2016, Front. Psychol..

[13]  Donald W. Pfaff,et al.  Deconstructing and reconstructing theory of mind , 2015, Trends in Cognitive Sciences.

[14]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[15]  W. H. Finch,et al.  Regularization Methods for Fitting Linear Models with Small Sample Sizes: Fitting the Lasso Estimator Using R. , 2016 .

[16]  C. Heyes,et al.  The cultural evolution of mind reading , 2014, Science.

[17]  S. Baron-Cohen Mindblindness: An Essay on Autism and Theory of Mind , 1997 .

[18]  D. Samuel Schwarzkopf,et al.  Individual differences in visual salience vary along semantic dimensions , 2018 .

[19]  Nicola C. Anderson,et al.  Curious eyes: Individual differences in personality predict eye movement behavior in scene-viewing , 2012, Cognition.

[20]  T. Tolmunen,et al.  Alexithymia Is Associated With Increased Cardiovascular Mortality in Middle-Aged Finnish Men , 2010, Psychosomatic medicine.

[21]  F. Leweke,et al.  Is Alexithymia Associated with Specific Mental Disorders , 2011, Psychopathology.

[22]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[23]  P. Fletcher,et al.  Seeing other minds: attributed mental states influence perception , 2010, Trends in Cognitive Sciences.

[24]  Daniel M McNeish,et al.  Using Lasso for Predictor Selection and to Assuage Overfitting: A Method Long Overlooked in Behavioral Sciences , 2015, Multivariate behavioral research.

[25]  C. Freitag,et al.  Evaluation der deutschen Version des Autismus-Spektrum-Quotienten (AQ) - die Kurzversion AQ-k , 2007 .

[26]  Satoru Hayasaka,et al.  Development of PowerMap: a Software Package for Statistical Power Calculation in Neuroimaging Studies , 2012, Neuroinformatics.

[27]  Simone G. Shamay-Tsoory,et al.  Dissociable prefrontal networks for cognitive and affective theory of mind: A lesion study , 2007, Neuropsychologia.

[28]  Kai Vogeley,et al.  Why we interact: On the functional role of the striatum in the subjective experience of social interaction , 2014, NeuroImage.

[29]  Riitta Hari,et al.  Engagement of amygdala in third‐person view of face‐to‐face interaction , 2012, Human brain mapping.

[30]  H. Völzke,et al.  Irritable bowel syndrome, mental health, and quality of life: Data from a population‐based survey in Germany (SHIP‐Trend‐0) , 2018, Neurogastroenterology and motility : the official journal of the European Gastrointestinal Motility Society.

[31]  Paul E. Dux,et al.  Causal evidence of right temporal parietal junction involvement in implicit Theory of Mind processing , 2019, NeuroImage.

[32]  L. Stephen Miller,et al.  Executive Function Mechanisms of Theory of Mind , 2011, Journal of autism and developmental disorders.

[33]  Pierre-Yves Oudeyer,et al.  Towards a neuroscience of active sampling and curiosity , 2018, Nature Reviews Neuroscience.

[34]  R. Bagby,et al.  Twenty-five years with the 20-item Toronto Alexithymia Scale. , 2020, Journal of psychosomatic research.

[35]  Kim M. Dalton,et al.  Gaze fixation and the neural circuitry of face processing in autism , 2005, Nature Neuroscience.

[36]  David Castle,et al.  Current visual scanpath research: a review of investigations into the psychotic, anxiety, and mood disorders. , 2011, Comprehensive psychiatry.

[37]  Susan B Perlman,et al.  Experimental manipulation of face-evoked activity in the fusiform gyrus of individuals with autism , 2011, Social neuroscience.

[38]  S. Bray,et al.  Manipulating visual scanpaths during facial emotion perception modulates functional brain activation in schizophrenia patients and controls. , 2019, Journal of abnormal psychology.

[39]  Nick Donnelly,et al.  It’s All in the Eyes: Subcortical and Cortical Activation during Grotesqueness Perception in Autism , 2013, PloS one.

[40]  Jürgen Baudewig,et al.  The Role of the Amygdala in Atypical Gaze on Emotional Faces in Autism Spectrum Disorders , 2012, The Journal of Neuroscience.

[41]  Nicole R. Zürcher,et al.  Look me in the eyes: constraining gaze in the eye-region provokes abnormally high subcortical activation in autism , 2017, Scientific Reports.

[42]  Daniel C. Richardson,et al.  The Role of Alexithymia in Reduced Eye-Fixation in Autism Spectrum Conditions , 2011, Journal of autism and developmental disorders.

[43]  Philipp Kanske,et al.  Dissecting the social brain: Introducing the EmpaToM to reveal distinct neural networks and brain–behavior relations for empathy and Theory of Mind , 2015, NeuroImage.

[44]  S. Baron-Cohen,et al.  The "Reading the Mind in the Eyes" Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[45]  C. Büchel,et al.  Amygdala Activation Predicts Gaze toward Fearful Eyes , 2009, The Journal of Neuroscience.

[46]  M. Edwards,et al.  Alexithymia in Neurological Disease: A Review. , 2015, The Journal of neuropsychiatry and clinical neurosciences.

[47]  David Herrero-Fernández,et al.  Validation of the Reading the Mind in the Eyes Test in a healthy Spanish sample and women with anorexia nervosa , 2018, Cognitive neuropsychiatry.

[48]  Ljubomir J. Buturovic,et al.  Cross-validation pitfalls when selecting and assessing regression and classification models , 2014, Journal of Cheminformatics.

[49]  U. Frith Mind Blindness and the Brain in Autism , 2001, Neuron.

[50]  J. Lefaucheur,et al.  Theory of mind in multiple sclerosis: A neuropsychological and MRI study , 2017, Neuroscience Letters.

[51]  L. F. Barrett,et al.  Words are a context for mental inference. , 2019, Emotion.

[52]  Nicole R. Zürcher,et al.  Hypersensitivity to low intensity fearful faces in autism when fixation is constrained to the eyes , 2017, Human brain mapping.

[53]  G. Fink,et al.  It's in your eyes--using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. , 2010, Social cognitive and affective neuroscience.

[54]  Rachael E. Jack,et al.  The Human Face as a Dynamic Tool for Social Communication , 2015, Current Biology.

[55]  M. Lyvers,et al.  Parental bonding, adult attachment, and theory of mind: A developmental model of alexithymia and alcohol-related risk. , 2019, Journal of clinical psychology.

[56]  Nim Tottenham,et al.  Elevated amygdala response to faces and gaze aversion in autism spectrum disorder. , 2014, Social cognitive and affective neuroscience.

[57]  G. Baird,et al.  Alexithymia in Adolescents with Autism Spectrum Disorder: Its Relationship to Internalising Difficulties, Sensory Modulation and Social Cognition , 2015, Journal of Autism and Developmental Disorders.

[58]  Mark S. Edwards,et al.  Alexithymia and Mood: Recognition of Emotion in Self and Others. , 2017, The American journal of psychology.

[59]  C. Frith,et al.  Development and neurophysiology of mentalizing. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[60]  Nadim Joni Shah,et al.  Minds Made for Sharing: Initiating Joint Attention Recruits Reward-related Neurocircuitry , 2010, Journal of Cognitive Neuroscience.

[61]  Olivier Luminet,et al.  Personality-dependent effects of oxytocin: Greater social benefits for high alexithymia scorers , 2011, Biological Psychology.

[62]  G. McCarthy,et al.  Guided saccades modulate face- and body-sensitive activation in the occipitotemporal cortex during social perception , 2008, Brain and Cognition.

[63]  D. Premack,et al.  Does the chimpanzee have a theory of mind? , 1978, Behavioral and Brain Sciences.

[64]  Stefanie I. Becker,et al.  Eye movements reveal sustained implicit processing of others' mental states. , 2012, Journal of experimental psychology. General.

[65]  S. Frässle,et al.  Test‐retest reliability of effective connectivity in the face perception network , 2016, Human brain mapping.

[66]  Chiu-Hsieh Hsu,et al.  Role of theory of mind in emotional awareness and alexithymia: Implications for conceptualization and measurement , 2015, Consciousness and Cognition.

[67]  R. Saxe,et al.  Functional neuroimaging of theory of mind , 2013 .

[68]  G. McCarthy,et al.  Controlled scanpath variation alters fusiform face activation. , 2007, Social cognitive and affective neuroscience.

[69]  O. Raitakari,et al.  Is alexithymia associated with metabolic syndrome? A study in a healthy adult population , 2016, Psychiatry Research.

[70]  D. Mobbs,et al.  Alexithymia decreases altruism in real social decisions , 2013, Cortex.

[71]  Christian Büchel,et al.  Different amygdala subregions mediate valence-related and attentional effects of oxytocin in humans , 2010, Proceedings of the National Academy of Sciences.

[72]  M. Lumley,et al.  The Assessment of Alexithymia in Medical Settings: Implications for Understanding and Treating Health Problems , 2007, Journal of personality assessment.

[73]  P E Sifneos,et al.  The prevalence of 'alexithymic' characteristics in psychosomatic patients. , 1973, Psychotherapy and psychosomatics.

[74]  R. Bagby,et al.  The twenty-item Toronto Alexithymia Scale--I. Item selection and cross-validation of the factor structure. , 1994, Journal of psychosomatic research.

[75]  J. Perner,et al.  An evaluation of neurocognitive models of theory of mind , 2015, Front. Psychol..

[76]  Sylvia Richardson,et al.  High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking , 2018, Statistics and Computing.

[77]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[78]  Hiroshi Matsuda,et al.  Impaired self-awareness and theory of mind: An fMRI study of mentalizing in alexithymia , 2006, NeuroImage.

[79]  P. Fonagy,et al.  The neurobiology of mentalizing. , 2015, Personality disorders.

[80]  U. Frith,et al.  Do triangles play tricks? Attribution of mental states to animated shapes in normal and abnormal development , 2000 .

[81]  Katharina von Kriegstein,et al.  Neural mechanisms of eye contact when listening to another person talking , 2016, Social cognitive and affective neuroscience.

[82]  K. von Kriegstein,et al.  Brain mechanisms of eye contact during verbal communication predict autistic traits in neurotypical individuals , 2020, Scientific Reports.

[83]  Lauren A. Demers,et al.  The Relation of Alexithymic Traits to Affective Theory of Mind. , 2015, The American journal of psychology.

[84]  W. Einhäuser,et al.  Attention in natural scenes: Affective-motivational factors guide gaze independently of visual salience , 2017, Vision Research.

[85]  J. Malec,et al.  Relationships Between Alexithymia, Affect Recognition, and Empathy After Traumatic Brain Injury , 2014, The Journal of head trauma rehabilitation.

[86]  S. Baron-Cohen,et al.  Reading the Eyes: Evidence for the Role of Perception in the Development of a Theory of Mind , 1992 .

[87]  A. Kersting,et al.  Deployment of attention to emotional pictures varies as a function of externally-oriented thinking: An eye tracking investigation. , 2017, Journal of behavior therapy and experimental psychiatry.

[88]  A. Aleman,et al.  Dealing with Feelings: Characterization of Trait Alexithymia on Emotion Regulation Strategies and Cognitive-Emotional Processing , 2009, PloS one.

[89]  Matthew D. Lieberman,et al.  Putting Feelings Into Words , 2007, Psychological science.

[90]  Frans W Cornelissen,et al.  Fixation based event‐related fmri analysis: Using eye fixations as events in functional magnetic resonance imaging to reveal cortical processing during the free exploration of visual images , 2012, Human Brain Mapping.

[91]  E. Peterson,et al.  The Eyes Test as a Measure of Individual Differences: How much of the Variance Reflects Verbal IQ? , 2012, Front. Psychology.

[92]  Sven Apel,et al.  Toward conjoint analysis of simultaneous eye-tracking and fMRI data for program-comprehension studies , 2018, EMIP@ETRA.

[93]  F. Bermpohl,et al.  Social cognition in aggressive offenders: Impaired empathy, but intact theory of mind , 2017, Scientific Reports.

[94]  A. Bailey,et al.  Are there theory of mind regions in the brain? A review of the neuroimaging literature , 2009, Human brain mapping.

[95]  N. Hadjikhani,et al.  The effect of constraining eye-contact during dynamic emotional face perception—an fMRI study , 2017, Social cognitive and affective neuroscience.

[96]  John M. Henderson,et al.  Neural Correlates of Fixation Duration during Real-world Scene Viewing: Evidence from Fixation-related (FIRE) fMRI , 2015, Journal of Cognitive Neuroscience.