Human-Monkey Gaze Correlations Reveal Convergent and Divergent Patterns of Movie Viewing

The neuroanatomical organization of the visual system is largely similar across primate species, predicting similar visual behaviors and perceptions. Although responses to trial-by-trial presentation of static images suggest that primates share visual orienting strategies, these reduced stimuli fail to capture key elements of the naturalistic, dynamic visual world in which we evolved. Here, we compared the gaze behavior of humans and macaques when they viewed three different 3-minute movie clips. We found significant intersubject and interspecies gaze correlations, suggesting that both species attend a common set of events in each scene. Comparing human and monkey gaze behavior with a computational saliency model revealed that interspecies gaze correlations were driven by biologically relevant social stimuli overlooked by low-level saliency models. Additionally, humans, but not monkeys, tended to gaze toward the targets of viewed individual's actions or gaze. Together, these data suggest that human and monkey gaze behavior comprises converging and diverging informational strategies, driven by both scene content and context; they are not fully described by simple low-level visual models.

[1]  Thomas D. Albright,et al.  How Do Monkeys Look at Faces? , 1997, Journal of Cognitive Neuroscience.

[2]  L. Itti.  The iLab Neuromorphic Vision C + + Toolkit : Free tools for the next generation of vision algorithms , 2022 .

[3]  D. Heeger,et al.  Neurocinematics: The Neuroscience of Film , 2008 .

[4]  P. König,et al.  Differences of monkey and human overt attention under natural conditions , 2006, Vision Research.

[5]  K. Guo.  Initial fixation placement in face images is driven by top–down guidance , 2007, Experimental Brain Research.

[6]  Kristina J. Nielsen,et al.  Object features used by humans and monkeys to identify rotated shapes. , 2008, Journal of vision.

[7]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[8]  Nikos K. Logothetis,et al.  Eye movements of monkey observers viewing vocalizing conspecifics , 2006, Cognition.

[9]  Michael L. Platt,et al.  Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques , 2005, Current Biology.

[10]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[11]  Kristina J. Nielsen,et al.  Discrimination Strategies of Humans and Rhesus Monkeys for Complex Visual Displays , 2006, Current Biology.

[12]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[13]  Sasan Mahmoodi,et al.  How do monkeys view faces?—a study of eye movements , 2003, Experimental Brain Research.

[14]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[15]  Michael L. Platt,et al.  Social Attention and the Brain , 2009, Current Biology.

[16]  V. Tosi,et al.  Scanning eye movements made when viewing film: preliminary observations. , 1997, The International journal of neuroscience.

[17]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[18]  J. Kaas,et al.  Archontan Affinities as Reflected in the Visual System , 1993 .

[19]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[20]  Christof Koch,et al.  Predicting human gaze using low-level saliency combined with face detection , 2007, NIPS.

[21]  O. Hikosaka.  Basal Ganglia Mechanisms of Reward‐Oriented Eye Movement , 2007, Annals of the New York Academy of Sciences.

[22]  L A Krubitzer,et al.  Cortical connections of MT in four species of primates: Areal, modular, and retinotopic patterns , 1990, Visual Neuroscience.

[23]  N. Humphrey,et al.  How Monkeys Acquire a New Way of Seeing , 1976, Perception.

[24]  R. C. Langford.  How People Look at Pictures, A Study of the Psychology of Perception in Art. , 1936 .

[25]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[26]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[27]  M. Platt,et al.  Reflexive Social Attention in Monkeys and Humans , 2003, Current Biology.

[28]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[29]  Laurie R Santos,et al.  Primate brains in the wild: the sensory bases for social interactions , 2004, Nature Reviews Neuroscience.

[30]  J. Findlay,et al.  Rapid Detection of Person Information in a Naturalistic Scene , 2008, Perception.

[31]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[32]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[33]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[34]  S. Zeki,et al.  The chronoarchitecture of the cerebral cortex , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[35]  Robert A. Marino,et al.  Free viewing of dynamic stimuli by humans and monkeys. , 2009, Journal of vision.

[36]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[37]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[38]  Stephen V. Shepherd,et al.  Following Gaze: Gaze-Following Behavior as a Window into Social Cognition , 2010, Front. Integr. Neurosci..

[39]  Katalin M. Gothard,et al.  How do rhesus monkeys (Macaca mulatta) scan faces in a visual paired comparison task? , 2004, Animal Cognition.

[40]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[41]  Robert O Deaner,et al.  Mirroring of attention by neurons in macaque parietal cortex , 2009, Proceedings of the National Academy of Sciences.

[42]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[43]  Laurent Itti,et al.  Realistic avatar eye and head animation using a neurobiological model of visual attention , 2004, SPIE Optics + Photonics.

[44]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[45]  Eli Peli,et al.  Where people look when watching movies: Do all viewers look at the same place? , 2007, Comput. Biol. Medicine.

[46]  M. Hayhoe,et al.  What controls attention in natural environments? , 2001, Vision Research.

[47]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[48]  Keiichi Kitajo,et al.  Synchronization of spontaneous eyeblinks while viewing video stories , 2009, Proceedings of the Royal Society B: Biological Sciences.

[49]  Mary A. Peterson,et al.  Multiple perceptual strategies used by macaque monkeys for face recognition , 2008, Animal Cognition.

[50]  M. Platt,et al.  Neural Correlates of Social Target Value in Macaque Parietal Cortex , 2008, Current Biology.

[51]  P. Vuilleumier,et al.  Facial expression and selective attention , 2002 .

[52]  James Gips,et al.  Points of View: Where Do We Look When We Watch TV? , 2008, Perception.