Functional Mechanisms Encoding Others' Direction of Gaze in the Human Nervous System

The direction of others' gaze is a strong social signal to their intentions and future behavior. Pioneering electrophysiological research identified cell populations in the primate visual cortex that are tuned to specific directions of observed gaze, but the functional architecture of this system is yet to be precisely specified. Here, we develop a computational model of how others' gaze direction is flexibly encoded across sensory channels within the gaze system. We incorporate the divisive normalization of sensory responses—a computational mechanism that is thought to be widespread in sensory systems but has not been examined in the context of social vision. We demonstrate that the operation of divisive normalization in the gaze system predicts a surprising and distinctive pattern of perceptual changes after sensory adaptation to gaze stimuli and find that these predictions closely match the psychophysical effects of adaptation in human observers. We also find that opponent coding, broadband multichannel, and narrowband multichannel models of sensory coding make distinct predictions regarding the effects of adaptation in a normalization framework and find evidence in favor of broadband multichannel coding of gaze. These results reveal the functional principles that govern the neural encoding of gaze direction and support the notion that divisive normalization is a canonical feature of nervous system function. Moreover, this research provides a strong foundation for testing recent computational theories of neuropsychiatric conditions in which gaze processing is compromised, such as autism and schizophrenia.

[1]  S. Solomon,et al.  Moving Sensory Adaptation beyond Suppressive Effects in Single Neurons , 2014, Current Biology.

[2]  Shawn R. Olsen,et al.  Divisive Normalization in Olfactory Population Codes , 2010, Neuron.

[3]  Gillian Rhodes,et al.  Reduced gaze aftereffects are related to difficulties categorising gaze direction in children with autism , 2013, Neuropsychologia.

[4]  D. Angelaki,et al.  A computational perspective on autism , 2015, Proceedings of the National Academy of Sciences.

[5]  G. Arbanas.  Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[6]  Colin W G Clifford,et al.  About Turn , 2009, Psychological science.

[7]  Karl J. Friston,et al.  Computational psychiatry: the brain as a phantastic organ. , 2014, The lancet. Psychiatry.

[8]  J. D. den Boer,et al.  Social anxiety disorder/social phobia: epidemiology, diagnosis, neurobiology, and treatment. , 2000, Comprehensive psychiatry.

[9]  R. Normann,et al.  The effects of background illumination on the photoresponses of red and green cones. , 1979, The Journal of physiology.

[10]  C. Clifford,et al.  Visual representation of eye gaze is coded by a nonopponent multichannel system. , 2008, Journal of experimental psychology. General.

[11]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[12]  Johan D. Carlin,et al.  The neural basis of eye gaze processing , 2013, Current Opinion in Neurobiology.

[13]  Atsushi Senju,et al.  Atypical development of spontaneous social cognition in autism spectrum disorders , 2013, Brain and Development.

[14]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[15]  A. Cowey,et al.  Sensitivity to eye gaze in prosopagnosic patients and monkeys with superior temporal sulcus ablation , 1990, Neuropsychologia.

[16]  Colin W. G. Clifford,et al.  Dual-Route Model of the Effect of Head Orientation on Perceived Gaze Direction , 2014, Journal of experimental psychology. Human perception and performance.

[17]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[18]  A. J. Mistlin,et al.  Social signals analyzed at the single cell level : someone is looking at me, something touched me, something moved! , 1990 .

[19]  Colin W G Clifford,et al.  Gaze constancy in upright and inverted faces. , 2015, Journal of vision.

[20]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[21]  Alexandra G Rosati,et al.  Looking past the model species: diversity in gaze-following skills across primates , 2009, Current Opinion in Neurobiology.

[22]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[23]  Michael F. Green,et al.  Social cognition in schizophrenia , 2015, Nature Reviews Neuroscience.

[24]  C. Clifford,et al.  A real head turner: horizontal and vertical head directions are multichannel coded. , 2011, Journal of vision.

[25]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  M. Webster.  Visual Adaptation. , 2015, Annual review of vision science.

[27]  Johan D. Carlin,et al.  A Head View-Invariant Representation of Gaze Direction in Anterior Superior Temporal Sulcus , 2011, Current Biology.

[28]  Emilio Salinas,et al.  Vector reconstruction from firing rates , 1994, Journal of Computational Neuroscience.

[29]  J. Seyama,et al.  Eye direction aftereffect , 2006, Psychological research.

[30]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[31]  Neil C. Rabinowitz,et al.  Contrast Gain Control in Auditory Cortex , 2011, Neuron.

[32]  Satoru Suzuki,et al.  High-level Pattern Coding Revealed by Brief Shape Aftereffects , 2005 .

[33]  M. Carandini,et al.  Summation and division by neurons in primate visual cortex. , 1994, Science.

[34]  A. J. Mistlin,et al.  Visual cells in the temporal cortex sensitive to face view and gaze direction , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[35]  A. Cowey,et al.  The role of the 'face-cell' area in the discrimination and recognition of faces by monkeys. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[36]  G. Rhodes,et al.  Fitting the Mind to the World: Adaptation and after-effects in high-level vision , 2005 .

[37]  Isabelle Mareschal,et al.  Humans Have an Expectation That Gaze Is Directed Toward Them , 2013, Current Biology.

[38]  G. McCarthy,et al.  When Strangers Pass , 2004, Psychological science.

[39]  R. Dolan,et al.  Separate Coding of Different Gaze Directions in the Superior Temporal Sulcus and Inferior Parietal Lobule , 2007, Current Biology.

[40]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[41]  D. Povinelli,et al.  Mindblindness. An Essay on Autism and Theory of Mind Simon Baron-Cohen 1995 , 1996, Trends in Neurosciences.

[42]  William Hyde Wollaston,et al.  XIII. On the apparent direction of eyes in a portrait , 1824, Philosophical Transactions of the Royal Society of London.

[43]  D. Regan,et al.  Postadaptation orientation discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[44]  Michael P. Ewbank,et al.  Intact priors for gaze direction in adults with high-functioning autism spectrum conditions , 2016, Molecular Autism.

[45]  Nicola S. Clayton,et al.  Social Cognition Modulates the Sensory Coding of Observed Gaze Direction , 2009, Current Biology.

[46]  Sheng He,et al.  Viewer-Centered Object Representation in the Human Visual System Revealed by Viewpoint Aftereffects , 2005, Neuron.

[47]  R. Jenkins,et al.  I Thought You Were Looking at Me , 2006, Psychological science.

[48]  Karl J. Friston,et al.  A more precise look at context in autism , 2015, Proceedings of the National Academy of Sciences.

[49]  Stephen R. H. Langton.  Gaze Perception and Visually Mediated Attention , 2010 .

[50]  Leila Rezaei,et al.  Normal Interpupillary Distance Values in an Iranian Population , 2012, Journal of ophthalmic & vision research.

[51]  Reginald B. Adams,et al.  The science of social vision , 2010 .

[52]  A. Calder,et al.  The “where” of social attention: Head and body direction aftereffects arise from representations specific to cue type and not direction alone , 2016, Cognitive neuroscience.