Predicting actions from subtle preparatory movements

To study how people anticipate others' actions, we designed a competitive reaching task. Subjects faced each other separated by a Plexiglas screen and their finger movements in 3D space were recorded with sensors. The first subject (Attacker) was instructed to touch one of two horizontally arranged targets on the screen. The other subject (Blocker) touched the same target as quickly as possible. Average finger reaction times (fRTs) were fast, much faster than reactions to a dot moving on the screen in the same manner as the Attacker's finger. This suggests the presence of subtle preparatory cues in other parts of the Attacker's body. We also recorded videos of Attackers' movements and had Blockers play against unedited videos as well as videos that had all preparatory cues removed by editing out frames before Attacker finger movements started. Blockers' fRTs in response to the edited videos were significantly slower (∼90ms). Also, reversing the preparatory movements in the videos tricked the Blockers into choosing the incorrect target at the beginning of their movement. Next, we occluded various body parts of the Attacker and showed that fRTs slow down only when most of the body of the Attacker is occluded. These results indicate that informative cues are widely distributed over the body and Blockers can use any piece from a set of redundant cues for action prediction. Reaction times in each condition remained constant over the duration of the testing sessions indicating a lack of learning during the experiment. These results suggest that during a dynamic two-person interaction, human subjects possess a remarkable and built-in action reading capacity allowing them to predict others' goals and respond efficiently in this competitive setting.

[1]  Bartlett W. Mel,et al.  Combining Multiple Cues for Contour Detection: Lessons from (and to) the Visual Cortex , 2010 .

[2]  U. Neisser Cognition and reality: principles and implications , 1976 .

[3]  S. Runeson,et al.  Kinematic specification of dynamics as an informational basis for person and action perception: Expe , 1983 .

[4]  G. Csibra Action mirroring and action understanding: an alternative account , 1993 .

[5]  E. T. Klemmer Time uncertainty in simple reaction time. , 1956, Journal of experimental psychology.

[6]  B. Abernethy,et al.  Expertise and the Perception of Kinematic and Situational Probability Information , 2001, Perception.

[7]  B. Abernethy,et al.  How do World-Class Cricket Batsmen Anticipate a Bowler's Intention? , 2006, Quarterly journal of experimental psychology.

[8]  Stefan Treue,et al.  Feature-based attentional integration of color and visual motion. , 2006, Journal of vision.

[9]  Brett R Fajen,et al.  Anticipation from biological motion: the goalkeeper problem. , 2012, Journal of experimental psychology. Human perception and performance.

[10]  Roland S Johansson,et al.  Eye movements when observing predictable and unpredictable actions. , 2006, Journal of neurophysiology.

[11]  G. Knoblich,et al.  Predicting the Effects of Actions: Interactions of Perception and Action , 2001, Psychological science.

[12]  K. Nakayama,et al.  Adaptation aftereffects in the perception of gender from biological motion. , 2006, Journal of vision.

[13]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[14]  Paola Cesari,et al.  Fooling the kickers but not the goalkeepers: behavioral and neurophysiological correlates of fake action detection in soccer. , 2013, Cerebral cortex.

[15]  A. Woodward,et al.  Infants generate goal-based action predictions. , 2012, Developmental science.

[16]  Y. Coello,et al.  Individual differences in reading social intentions from motor deviants , 2015, Front. Psychol..

[17]  L J Boë,et al.  Visual Perception of Motor Anticipation in Cursive Handwriting: Influence of Spatial and Movement Information on the Prediction of Forthcoming Letters , 1997, Perception.

[18]  U. Neisser Cognition and reality: principles and implications , 1976 .

[19]  R. Johansson,et al.  Action plans used in action observation , 2003, Nature.

[20]  B. Abernethy,et al.  Do Expertise and the Degree of Perception—Action Coupling Affect Natural Anticipatory Performance? , 2003, Perception.

[21]  Anne Springer,et al.  Can you See me in the Snow? Action Simulation Aids the Detection of Visually Degraded Human Motion , 2011, Quarterly journal of experimental psychology.

[22]  S. Runeson,et al.  Visual perception of lifted weight. , 1981, Journal of experimental psychology. Human perception and performance.

[23]  J. Randall Flanagan,et al.  The role of observers' gaze behaviour when watching object manipulation tasks: predicting and evaluating the consequences of action , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[24]  Cristina Becchio,et al.  Intentions in the Brain , 2015, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[25]  U. Castiello,et al.  Different action patterns for cooperative and competitive behaviour , 2007, Cognition.

[26]  John M. Hollerbach,et al.  Dynamic interactions between limb segments during planar arm movement , 1982, Biological Cybernetics.

[27]  S. Lea,et al.  Perception of Emotion from Dynamic Point-Light Displays Represented in Dance , 1996, Perception.

[28]  Giovanni Pezzulo,et al.  The eye in hand: predicting others' behavior by integrating multiple sources of information. , 2015, Journal of neurophysiology.

[29]  Craig S. Chapman,et al.  Humans are sensitive to attention control when predicting others’ actions , 2016, Proceedings of the National Academy of Sciences.

[30]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[31]  Anne Springer,et al.  Before, during and after you disappear: aspects of timing and dynamic updating of the real-time action simulation of human motions , 2011, Psychological research.

[32]  C. Frith,et al.  How we predict what other people are going to do , 2006, Brain Research.

[33]  Yann Coello,et al.  Anticipating the terminal position of an observed action: Effect of kinematic, structural, and identity information , 2011 .

[34]  J. Starkes,et al.  A new technology and field test of advance cue usage in volleyball. , 1995, Research quarterly for exercise and sport.

[35]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[36]  J. Cutting,et al.  Recognizing the sex of a walker from a dynamic point-light display , 1977 .

[37]  Louis-Jean Boë,et al.  Visual detection of coarticulatory anticipation or...guessing what has not yet been written , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[38]  U. Castiello,et al.  Cues to intention: The role of movement information , 2011, Cognition.

[39]  C. Urgesi,et al.  Action anticipation and motor resonance in elite basketball players , 2008, Nature Neuroscience.

[40]  Yann Coello,et al.  Facilitation effect of observed motor deviants in a cooperative motor task: Evidence for direct perception of social intention in action , 2016, Quarterly journal of experimental psychology.

[41]  Yann Coello,et al.  Perceiving what you intend to do from what you do: evidence for embodiment in social interactions , 2015, Socioaffective neuroscience & psychology.

[42]  M. Shiffrar,et al.  Recognizing people from their movement. , 2005, Journal of experimental psychology. Human perception and performance.

[43]  V. Gurfinkel,et al.  [Control elements of voluntary movements]. , 1967, Biofizika.

[44]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[45]  V. Manera,et al.  Cooperation or competition? Discriminating between social intentions by observing prehensile movements , 2011, Experimental Brain Research.

[46]  K. Nakayama,et al.  Role of focal attention on latencies and trajectories of visually guided manual pointing. , 2006, Journal of vision.

[47]  Belen'kiĭ Ve,et al.  Control elements of voluntary movements , 1967 .

[48]  M. Shiffrar,et al.  The visual analysis of emotional actions , 2006, Social neuroscience.

[49]  Daniel Jokisch,et al.  Biological motion as a cue for the perception of size. , 2003, Journal of vision.

[50]  G. Rizzolatti,et al.  I Know What You Are Doing A Neurophysiological Study , 2001, Neuron.

[51]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[52]  B. Abernethy,et al.  Pickup of Essential Kinematics Underpins Expert Perception of Movement Patterns , 2007, Journal of motor behavior.

[53]  N. Hodges,et al.  On the dynamic information underlying visual anticipation skill , 2008, Perception & psychophysics.

[54]  Rajiv Ranganathan,et al.  Perception-Action Coupling and Anticipatory Performance in Baseball Batting , 2007, Journal of motor behavior.

[55]  M. Brass,et al.  Investigating Action Understanding: Inferential Processes versus Action Simulation , 2007, Current Biology.

[56]  M. Jeannerod,et al.  Optimal response of eye and hand motor systems in pointing at a visual target , 1979, Biological Cybernetics.

[57]  T. Falck-Ytter Predicting other people's action goals with low-level motor information. , 2012, Journal of neurophysiology.

[58]  N. Troje,et al.  Person identification from biological motion: Effects of structural and kinematic cues , 2005, Perception & psychophysics.

[59]  Martin A. Giese,et al.  Predicting point-light actions in real-time , 2010 .

[60]  J E Cutting,et al.  Masking the motions of human gait , 1988, Perception & psychophysics.

[61]  Natalie Sebanz,et al.  Prediction in Joint Action: What, When, and Where , 2009, Top. Cogn. Sci..