Attention, biological motion, and action recognition

Interacting with others in the environment requires that we perceive and recognize their movements and actions. Neuroimaging and neuropsychological studies have indicated that a number of brain regions, particularly the superior temporal sulcus, are involved in a number of processes essential for action recognition, including the processing of biological motion and processing the intentions of actions. We review the behavioral and neuroimaging evidence suggesting that while some aspects of action recognition might be rapid and effective, they are not necessarily automatic. Attention is particularly important when visual information about actions is degraded or ambiguous, or if competing information is present. We present evidence indicating that neural responses associated with the processing of biological motion are strongly modulated by attention. In addition, behavioral and neuroimaging evidence shows that drawing inferences from the actions of others is attentionally demanding. The role of attention in action observation has implications for everyday social interactions and workplace applications that depend on observing, understanding and interpreting actions.

[1]  Anjan Chatterjee,et al.  Specificity of Action Representations in the Lateral Occipitotemporal Cortex , 2006, Journal of Cognitive Neuroscience.

[2]  Jason P. Mitchell.  Activity in right temporo-parietal junction is not selective for theory-of-mind. , 2008, Cerebral cortex.

[3]  Kevin A. Pelphrey,et al.  Grasping the Intentions of Others: The Perceived Intentionality of an Action Influences Activity in the Superior Temporal Sulcus during Social Perception , 2004, Journal of Cognitive Neuroscience.

[4]  K. Hiraki,et al.  The relative importance of spatial versus temporal structure in the perception of biological motion: An event-related potential study , 2006, Cognition.

[5]  John A. Pyles,et al.  fMR-Adaptation Reveals Invariant Coding of Biological Motion on the Human STS , 2009, Front. Hum. Neurosci..

[6]  Paul E. Downing,et al.  Representation of Action in Occipito-temporal Cortex , 2011, Journal of Cognitive Neuroscience.

[7]  Aina Puce,et al.  Viewing the motion of human body parts activates different regions of premotor, temporal, and parietal cortex , 2004, NeuroImage.

[8]  Scott T. Grafton,et al.  Action outcomes are represented in human inferior frontoparietal cortex. , 2008, Cerebral cortex.

[9]  J. Haxby,et al.  Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements , 2002, Neuron.

[10]  Audrey R. Nath,et al.  Dynamic Changes in Superior Temporal Sulcus Connectivity during Perception of Noisy Audiovisual Speech , 2011, The Journal of Neuroscience.

[11]  G. Orban,et al.  Human Functional Magnetic Resonance Imaging Reveals Separation and Integration of Shape and Motion Cues in Biological Motion Processing , 2009, The Journal of Neuroscience.

[12]  N. Kanwisher,et al.  The Human Body , 2001 .

[13]  Ivan Toni,et al.  Movement-Specific Repetition Suppression in Ventral and Dorsal Premotor Cortex during Action Observation , 2009, Cerebral cortex.

[14]  Pierre Fonlupt,et al.  Listening to a walking human activates the temporal biological motion area , 2005, NeuroImage.

[15]  Randolph Blake,et al.  Learning to See Biological Motion: Brain Activity Parallels Behavior , 2004, Journal of Cognitive Neuroscience.

[16]  D. Perrett,et al.  Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. , 1996, Journal of neurophysiology.

[17]  Wendy Baccus,et al.  Early integration of form and motion in the neural response to biological motion , 2009, Neuroreport.

[18]  Alan C. Evans,et al.  Specific Involvement of Human Parietal Systems and the Amygdala in the Perception of Biological Motion , 1996, The Journal of Neuroscience.

[19]  Tjeerd Jellema,et al.  Neural representations of perceived bodily actions using a categorical frame of reference , 2006, Neuropsychologia.

[20]  G. Orban,et al.  Coding observed motor acts: different organizational principles in the parietal and premotor cortex of humans. , 2010, Journal of neurophysiology.

[21]  A. Saygin.  Superior temporal and premotor brain areas necessary for biological motion perception. , 2007, Brain : a journal of neurology.

[22]  N. Lavie.  Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[23]  Ehud Zohary,et al.  Dissociation between Ventral and Dorsal fMRI Activation during Object and Action Recognition , 2005, Neuron.

[24]  Raja Parasuraman,et al.  Neuroergonomics: The Brain at Work , 2006 .

[25]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[26]  K. Nakayama,et al.  Intact “biological motion” and “structure from motion” perception in a patient with impaired motion mechanisms: A case study , 1990, Visual Neuroscience.

[27]  Walter R. Boot,et al.  Effects of training strategies implemented in a complex videogame on functional connectivity of attentional networks , 2012, NeuroImage.

[28]  Q. Vuong,et al.  Incidental Processing of Biological Motion , 2004, Current Biology.

[29]  C.J. Cohen,et al.  A Surveillance System for the Recognition of Intent within Individuals and Crowds , 2008, 2008 IEEE Conference on Technologies for Homeland Security.

[30]  J. Mazziotta,et al.  Grasping the Intentions of Others with One's Own Mirror Neuron System , 2005, PLoS biology.

[31]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[32]  Linda I. Shuster,et al.  Resource theory: Here, there, and everywhere , 2004 .

[33]  K. Nakayama,et al.  Attention, pattern recognition and popout in visual search , 1998 .

[34]  Nancy J. Cooke.  Human Factors of Remotely Operated Vehicles , 2006 .

[35]  Scott T. Grafton,et al.  Actions or Hand-Object Interactions? Human Inferior Frontal Cortex and Action Observation , 2003, Neuron.

[36]  Nikolaus F. Troje,et al.  Structural encoding and recognition of biological motion: evidence from event-related potentials and source analysis , 2005, Behavioural Brain Research.

[37]  Aina Puce,et al.  Electrophysiology and brain imaging of biological motion. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[38]  D. Gopher,et al.  Practice under changing priorities: An approach to the training of complex skills☆ , 1989 .

[39]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[40]  Leslie G. Ungerleider,et al.  Selective attention to face identity and color studied with f MRI , 1997, Human brain mapping.

[41]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[42]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[43]  Jason B. Mattingley,et al.  Selective attention modulates inferior frontal gyrus activity during action observation , 2008, NeuroImage.

[44]  Á. Pascual-Leone,et al.  Repetitive TMS over posterior STS disrupts perception of biological motion , 2005, Vision Research.

[45]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[46]  Scott T. Grafton,et al.  Spatio-Temporal Dynamics of Human Intention Understanding in Temporo-Parietal Cortex: A Combined EEG/fMRI Repetition Suppression Paradigm , 2009, PloS one.

[47]  G. Orban,et al.  Specificity of regions processing biological motion , 2005, The European journal of neuroscience.

[48]  Aina Puce,et al.  Cortical Networks Representing Object Categories and High-level Attributes of Familiar Real-world Action Sounds , 2011, Journal of Cognitive Neuroscience.

[49]  R. Saxe,et al.  Making sense of another mind: The role of the right temporo-parietal junction , 2005, Neuropsychologia.

[50]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[51]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.

[52]  M. Sereno,et al.  Point-Light Biological Motion Perception Activates Human Premotor Cortex , 2004, The Journal of Neuroscience.

[53]  T. Flash,et al.  Neuronal encoding of human kinematic invariants during action observation. , 2010, Cerebral cortex.

[54]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[55]  Karl J. Friston,et al.  Evidence of Mirror Neurons in Human Inferior Frontal Gyrus , 2009, The Journal of Neuroscience.

[56]  A. H. Tickner,et al.  Monitoring 16 Television Screens Showing Little Movement , 1972 .

[57]  N. Lavie.  Perceptual load as a necessary condition for selective attention. , 1995, Journal of experimental psychology. Human perception and performance.

[58]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[59]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[60]  I. Robertson,et al.  `Oops!': Performance correlates of everyday attentional failures in traumatic brain injured and normal subjects , 1997, Neuropsychologia.

[61]  R. Blake,et al.  Brain Areas Active during Visual Perception of Biological Motion , 2002, Neuron.

[62]  N. Kanwisher,et al.  fMRI Adaptation Reveals Mirror Neurons in Human Inferior Parietal Cortex , 2008, Current Biology.

[63]  Alison J. Wiggett,et al.  Patterns of fMRI Activity Dissociate Overlapping Functional Brain Areas that Respond to Biological Motion , 2006, Neuron.

[64]  David M. Sobel,et al.  Action Understanding in the Superior Temporal Sulcus Region , 2009, Psychological science.

[65]  Ronald A. Rensink,et al.  Active versus passive processing of biological motion , 2002, Perception.

[66]  G. Mather,et al.  Low-level visual processing of biological motion , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[67]  Giorgio Vallortigara,et al.  Visually Inexperienced Chicks Exhibit Spontaneous Preference for Biological Motion Patterns , 2005, PLoS biology.

[68]  Roel M. Willems,et al.  Complementary Systems for Understanding Action Intentions , 2008, Current Biology.

[69]  R. Parasuraman,et al.  Detecting threat-related intentional actions of others: effects of image quality, response mode, and target cuing on vigilance. , 2009, Journal of experimental psychology. Applied.

[70]  Roberto Cipolla,et al.  Structure from motion , 2008 .

[71]  F. Simion,et al.  A predisposition for biological motion in the newborn baby , 2008, Proceedings of the National Academy of Sciences.

[72]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[73]  Aina Puce,et al.  Configural Processing of Biological Motion in Human Superior Temporal Sulcus , 2005, The Journal of Neuroscience.

[74]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[75]  Raja Parasuraman,et al.  Object-Based Attentional Modulation of Biological Motion Processing: Spatiotemporal Dynamics Using Functional Magnetic Resonance Imaging and Electroencephalography , 2010, The Journal of Neuroscience.