Eye Movements During Action Observation

An important element in social interactions is predicting the goals of others, including the goals of others’ manual actions. Over a decade ago, Flanagan and Johansson demonstrated that, when observing other people reaching for objects, the observer’s gaze arrives at the goal before the action is completed. Moreover, those authors proposed that this behavior was mediated by an embodied process, which takes advantage of the observer’s motor knowledge. Here, we scrutinize work that has followed that seminal article. We include studies on adults that have used combined eye tracking and transcranial magnetic stimulation technologies to test causal hypotheses about underlying brain circuits. We also include developmental studies on human infants. We conclude that, although several aspects of the embodied process of predictive eye movements remain to be clarified, current evidence strongly suggests that the motor system plays a causal role in guiding predictive gaze shifts that focus on another person’s future goal. The early emergence of the predictive gaze in infant development underlines its importance for social cognition and interaction.

[1]  B. Abernethy Expertise, Visual Search, and Information Pick-up in Squash , 1990, Perception.

[2]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[3]  G. Rizzolatti,et al.  Motor facilitation during action observation: a magnetic stimulation study. , 1995, Journal of neurophysiology.

[4]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[5]  J. Vickers,et al.  Visual control when aiming at a far target. , 1996, Journal of experimental psychology. Human perception and performance.

[6]  A E Patla,et al.  Where and when do we look as we approach and step over an obstacle in the travel path? , 1997, Neuroreport.

[7]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[8]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[9]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[10]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[11]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[12]  G. Csibra,et al.  Teleological reasoning in infancy: the naı̈ve theory of rational action , 2003, Trends in Cognitive Sciences.

[13]  J. Henderson Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[14]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[15]  R. Johansson,et al.  Action plans used in action observation , 2003, Nature.

[16]  Scott P. Johnson,et al.  Development of object concepts in infancy: Evidence for early learning in an eye-tracking paradigm , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[17]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[18]  D. Perrett,et al.  Opinion TRENDS in Cognitive Sciences Vol.8 No.11 November 2004 Demystifying social cognition: a Hebbian perspective , 2022 .

[19]  C. Von Hofsten An action perspective on motor development. , 2004, Trends in cognitive sciences.

[20]  C. Von Hofsten,et al.  Infants' Evolving Representations of Object Motion During Occlusion: A Longitudinal Study of 6- to 12-Month-Old Infants. , 2004, Infancy : the official journal of the International Society on Infant Studies.

[21]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[22]  R. Johansson,et al.  Eye–Hand Coordination during Learning of a Novel Visuomotor Task , 2005, The Journal of Neuroscience.

[23]  C. Hofsten,et al.  Infants predict other people's action goals , 2006, Nature Neuroscience.

[24]  Roland S Johansson,et al.  Eye movements when observing predictable and unpredictable actions. , 2006, Journal of neurophysiology.

[25]  M. Iacoboni,et al.  The mirror neuron system and the consequences of its dysfunction , 2006, Nature Reviews Neuroscience.

[26]  G. Rizzolatti,et al.  Impairment of actions chains in autism and its possible role in intention understanding , 2007, Proceedings of the National Academy of Sciences.

[27]  C. Von Hofsten,et al.  Taking an action perspective on infant's object representations. , 2007, Progress in brain research.

[28]  G. Csibra,et al.  Action Anticipation Through Attribution of False Belief by 2-Year-Olds , 2007, Psychological science.

[29]  Olga Kochukhova,et al.  Learning about occlusion: Initial assumptions and rapid adjustments , 2007, Cognition.

[30]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[31]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[32]  A. Woodward,et al.  Action Anticipation and Interference: A Test of Prospective Gaze. , 2008, CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference.

[33]  M. Land Vision, eye movements, and natural behavior , 2009, Visual Neuroscience.

[34]  Rik Eshuis,et al.  Predictive Eye Movements Are Driven by Goals, Not by the Mirror Neuron System , 2009, Psychological science.

[35]  C. Von Hofsten,et al.  Action type and goal type modulate goal-directed gaze shifts in 14-month-old infants. , 2009, Developmental psychology.

[36]  Terje Falck-Ytter,et al.  Young children with autism spectrum disorder use predictive eye movements in action observation , 2010, Biology Letters.

[37]  Olga Kochukhova,et al.  Goal anticipation during action observation is influenced by synonymous action capabilities, a puzzling developmental study , 2010, Experimental Brain Research.

[38]  Giulio Sandini,et al.  The iCub humanoid robot: An open-systems platform for research in cognitive development , 2010, Neural Networks.

[39]  G. Gredebäck,et al.  Infants’ understanding of everyday social interactions: A dual process account , 2010, Cognition.

[40]  Harold Bekkering,et al.  The early development of object knowledge: a study of infants' visual anticipations during action observation. , 2010, Developmental psychology.

[41]  Olga Kochukhova,et al.  Preverbal infants anticipate that food will be brought to the mouth: an eye tracking study of manual feeding and flying spoons. , 2010, Child development.

[42]  C. Heyes Where do mirror neurons come from? , 2010, Neuroscience & Biobehavioral Reviews.

[43]  Yasuhiro Kanakogi,et al.  Developmental correspondence between action prediction and motor ability in early infancy. , 2011, Nature communications.

[44]  H. Bekkering,et al.  Can 14- to 20-month-old children learn that a tool serves multiple purposes? A developmental study on children’s action goal prediction , 2011, Vision Research.

[45]  C. Hofsten,et al.  Predictive gaze shifts elicited during observed and performed actions in 10-month-old infants and adults , 2011, Neuropsychologia.

[46]  Victoria Southgate,et al.  Do 18-Month-Olds Really Attribute Mental States to Others? , 2011, Psychological science.

[47]  David Vernon,et al.  A Roadmap for Cognitive Development in Humanoid Robots , 2011, Cognitive Systems Monographs.

[48]  Kasey C. Soska,et al.  Head-mounted eye tracking: a new method to describe infant looking. , 2011, Child development.

[49]  M. Costantini,et al.  Grasping with the eyes. , 2011, Journal of neurophysiology.

[50]  Satoshi Hirata,et al.  Humans and chimpanzees attend differently to goal-directed actions. , 2012, Nature communications.

[51]  A. Woodward,et al.  Action production influences 12-month-old infants' attention to others' actions. , 2012, Developmental science.

[52]  Alessandra Sciutti,et al.  Anticipatory gaze in human-robot interactions , 2012 .

[53]  M. Costantini,et al.  Does how I look at what you're doing depend on what I'm doing? , 2012, Acta psychologica.

[54]  G. Gredebäck,et al.  Humans Anticipate the Goal of other People’s Point-Light Actions , 2012, Front. Psychology.

[55]  Gustaf Gredebäck,et al.  Goal Salience Affects Infants’ Goal-Directed Gaze Shifts , 2012, Front. Psychology.

[56]  Moritz M. Daum,et al.  Actions Seen through Babies’ Eyes: A Dissociation between Looking Time and Predictive Gaze , 2012, Front. Psychology.

[57]  Moritz M. Daum,et al.  Production and perception of contralateral reaching: a close link by 12 months of age. , 2012, Infant behavior & development.

[58]  M. Costantini,et al.  Tie my hands, tie my eyes. , 2012, Journal of experimental psychology. Human perception and performance.

[59]  J. Mattingley,et al.  Brain regions with mirror properties: A meta-analysis of 125 human fMRI studies , 2012, Neuroscience & Biobehavioral Reviews.

[60]  M. Costantini,et al.  Out of your hand's reach, out of my eyes' reach , 2012, Quarterly journal of experimental psychology.

[61]  Christine Fawcett,et al.  Infants use social context to bind actions into a collaborative sequence. , 2013, Developmental science.

[62]  Victoria Southgate,et al.  Do infants provide evidence that the mirror system is involved in action understanding?☆ , 2013, Consciousness and Cognition.

[63]  Luciano Fadiga,et al.  The motor cortex is causally related to predictive eye movements during action observation , 2013, Neuropsychologia.

[64]  S. Bíró,et al.  The role of the efficiency of novel actions in infants' goal anticipation. , 2013, Journal of experimental child psychology.

[65]  Cecilia Heyes,et al.  A new approach to mirror neurons: Developmental history, system-level theory and intervention experiments , 2013, Cortex.

[66]  M. Costantini,et al.  Looking Ahead: Anticipatory Gaze and Motor Ability in Infancy , 2013, PloS one.

[67]  G. Gredebäck,et al.  Extrapolation and direct matching mediate anticipation in infancy. , 2014, Infant behavior & development.

[68]  Amanda C. Brandone,et al.  Infants' goal anticipation during failed and successful reaching actions. , 2014, Developmental science.

[69]  Culture Influences Action Understanding in Infancy: A Comparative Study of Action Prediction in Chinese and Swedish Infants , 2014 .

[70]  G. Gredebäck,et al.  Goal certainty modulates infants' goal-directed gaze shifts. , 2014, Developmental psychology.

[71]  M. Costantini,et al.  How your hand drives my eyes. , 2014, Social cognitive and affective neuroscience.

[72]  C. Keysers,et al.  Hebbian learning and predictive mirror neurons for actions, sensations and emotions , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[73]  Christine Fawcett,et al.  Eighteen-Month-Olds, but not 14-Month-Olds, Use Social Context to Bind Action Sequences , 2014, Infancy : the official journal of the International Society on Infant Studies.

[74]  Moritz M. Daum,et al.  The Microstructure of Action Perception in Infancy: Decomposing the Temporal Structure of Social Information Processing , 2015, Child development perspectives.

[75]  C. Turati,et al.  The effect of biomechanical properties of motion on infants' perception of goal-directed grasping actions. , 2015, Journal of experimental child psychology.