Investigating the neural basis of basic human movement perception using multi-voxel pattern analysis

Humans can skillfully recognize actions from others’ body motion and make a judgment or response at once. Previous neuroimaging studies have mostly utilized diminished and brief human motion stimuli and indicated that human occipito-temporal cortex plays a critical role at biological motion recognition. It remains unclear to what extent that the areas related to human motion perception are involved in decoding basic movements. Because human movement naturally stems from the sequences of body posture, so we utilized the stimulus of real movements. Participants were presented four categories of human movements (jump, run, skip and walk) in a blocked fMRI experiment. Multi-voxel pattern analysis (MVPA) was adopted to assess whether different movements could be discriminated in four regions. We found that movement-specific information was represented in both human body-sensitive areas, extrastriate body area (EBA) and motion-sensitive areas, posterior superior temporal sulcus (pSTS) and human middle temporal complex (hMT+). Additionally, a further functional connectivity analysis using EBA as a seed was conducted and it suggested that EBA showed a task-modulated functional connectivity with multiple areas that were involved in the behavior perception and motor control. Human motion processing appeared to be completed in a distributed network. The occipito-temporal cortex may perform the initial processing of human motion information extracting, and then transform them to interconnected areas for a further utilization.

[1]  M. Candidi,et al.  Representation of body identity and body actions in extrastriate body area and ventral premotor cortex , 2007, Nature Neuroscience.

[2]  Nikolaus Kriegeskorte,et al.  Analyzing for information, not activation, to exploit high-resolution fMRI , 2007, NeuroImage.

[3]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[4]  Alison J. Wiggett,et al.  The role of the extrastriate body area in action perception , 2006, Social neuroscience.

[5]  P. Downing,et al.  The lateral occipitotemporal cortex in action , 2015, Trends in Cognitive Sciences.

[6]  Ayse Pinar Saygin,et al.  Representational similarity of actions in the human brain , 2016, 2016 International Workshop on Pattern Recognition in Neuroimaging (PRNI).

[7]  Neil G. Muggleton,et al.  Effects of TMS over Premotor and Superior Temporal Cortices on Biological Motion Perception , 2012, Journal of Cognitive Neuroscience.

[8]  Rebecca F. Schwarzlose,et al.  Separate face and body selectivity on the fusiform gyrus. , 2010, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Geraint Rees,et al.  Ventral aspect of the visual form pathway is not critical for the perception of biological motion , 2015, Proceedings of the National Academy of Sciences.

[10]  Anjan Chatterjee,et al.  Specificity of Action Representations in the Lateral Occipitotemporal Cortex , 2006, Journal of Cognitive Neuroscience.

[11]  Amir Amedi,et al.  Visual Cortex Extrastriate Body-Selective Area Activation in Congenitally Blind People “Seeing” by Using Sounds , 2014, Current Biology.

[12]  Russell A. Epstein,et al.  Neural Representations of Observed Actions Generalize across Static and Dynamic Visual Input , 2017, The Journal of Neuroscience.

[13]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[14]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[15]  R. Blake,et al.  Brain Areas Active during Visual Perception of Biological Motion , 2002, Neuron.

[16]  P. Downing,et al.  The role of occipitotemporal body-selective regions in person perception , 2011, Cognitive neuroscience.

[17]  Dietrich Grönemeyer,et al.  Reduced connectivity between the left fusiform body area and the extrastriate body area in anorexia nervosa is associated with body image distortion , 2013, Behavioural Brain Research.

[18]  C. Stevens,et al.  Posture-based processing in visual short-term memory for actions , 2014, Quarterly journal of experimental psychology.

[19]  Simon B Eickhoff,et al.  Brain regions involved in human movement perception: A quantitative voxel‐based meta‐analysis , 2012, Human brain mapping.

[20]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[21]  John A. Pyles,et al.  fMR-Adaptation Reveals Invariant Coding of Biological Motion on the Human STS , 2009, Front. Hum. Neurosci..

[22]  Randolph Blake,et al.  Learning to See Biological Motion: Brain Activity Parallels Behavior , 2004, Journal of Cognitive Neuroscience.

[23]  Moritz F. Wurm,et al.  Decoding Actions at Different Levels of Abstraction , 2015, The Journal of Neuroscience.

[24]  P. Downing,et al.  Selectivity for the human body in the fusiform gyrus. , 2005, Journal of neurophysiology.

[25]  Wendy Baccus,et al.  Form and motion make independent contributions to the response to biological motion in occipitotemporal cortex , 2012, NeuroImage.

[26]  Joris Vangeneugden,et al.  Distinct Neural Mechanisms for Body Form and Body Motion Discriminations , 2014, The Journal of Neuroscience.

[27]  R. Blake,et al.  Brain activity evoked by inverted and imagined biological motion , 2001, Vision Research.

[28]  Emily S. Cross,et al.  Dissociable substrates for body motion and physical experience in the human action observation network , 2009, The European journal of neuroscience.

[29]  Luca Turella,et al.  MEG Multivariate Analysis Reveals Early Abstract Action Representations in the Lateral Occipitotemporal Cortex , 2015, The Journal of Neuroscience.

[30]  Daniel M Wegner,et al.  The neural substrates of action identification. , 2010, Social cognitive and affective neuroscience.

[31]  D. Sheinberg,et al.  Temporal Cortex Neurons Encode Articulated Actions as Slow Sequences of Integrated Poses , 2010, The Journal of Neuroscience.

[32]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[33]  Steven M. Thurman,et al.  Neural adaptation in pSTS correlates with perceptual aftereffects to biological motion and with autistic traits , 2016, NeuroImage.

[34]  Anjan Chatterjee,et al.  Rethinking actions: implementation and association. , 2015, Wiley interdisciplinary reviews. Cognitive science.

[35]  J. Lange,et al.  A Model of Biological Motion Perception from Configural Form Cues , 2006, The Journal of Neuroscience.

[36]  A. Saygin Superior temporal and premotor brain areas necessary for biological motion perception. , 2007, Brain : a journal of neurology.

[37]  Raja Parasuraman,et al.  Attention, biological motion, and action recognition , 2012, NeuroImage.

[38]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[39]  Ivan Toni,et al.  The Extrastriate Body Area Computes Desired Goal States during Action Planning123 , 2016, eNeuro.

[40]  N. Kanwisher,et al.  The Human Body , 2001 .

[41]  Angela D. Friederici,et al.  The Detection of Communicative Signals Directed at the Self in Infant Prefrontal Cortex , 2010, Front. Hum. Neurosci..

[42]  Alison J. Wiggett,et al.  Functional MRI analysis of body and body part representations in the extrastriate and fusiform body areas. , 2007, Journal of neurophysiology.

[43]  Tomaso Poggio,et al.  A fast, invariant representation for human action in the visual system. , 2018, Journal of neurophysiology.

[44]  G. Orban,et al.  Human Functional Magnetic Resonance Imaging Reveals Separation and Integration of Shape and Motion Cues in Biological Motion Processing , 2009, The Journal of Neuroscience.

[45]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[46]  Alfonso Caramazza,et al.  Action categories in lateral occipitotemporal cortex are organized along sociality and transitivity. , 2016, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  Stefan Everling,et al.  Distinct and distributed functional connectivity patterns across cortex reflect the domain-specific constraints of object, face, scene, body, and tool category-selective modules in the ventral visual pathway , 2014, NeuroImage.

[48]  Lucía Amoruso,et al.  Beyond Extrastriate Body Area (EBA) and Fusiform Body Area (FBA): Context Integration in the Meaning of Actions , 2011, Front. Hum. Neurosci..

[49]  T. Poggio,et al.  Cognitive neuroscience: Neural mechanisms for the recognition of biological movements , 2003, Nature Reviews Neuroscience.

[50]  D. Perrett,et al.  A region of right posterior superior temporal sulcus responds to observed intentional actions , 2004, Neuropsychologia.

[51]  Alison J. Wiggett,et al.  Behavioral / Systems / Cognitive Functional Magnetic Resonance Imaging Investigation of Overlapping Lateral Occipitotemporal Activations Using Multi-Voxel Pattern Analysis , 2006 .

[52]  Paul E. Downing,et al.  Body selectivity in occipitotemporal cortex: Causal evidence , 2016, Neuropsychologia.

[53]  Paul E. Downing,et al.  Is the extrastriate body area involved in motor actions? , 2005, Nature Neuroscience.

[54]  Alison J. Wiggett,et al.  Patterns of fMRI Activity Dissociate Overlapping Functional Brain Areas that Respond to Biological Motion , 2006, Neuron.

[55]  Susan L. Whitfield-Gabrieli,et al.  Conn: A Functional Connectivity Toolbox for Correlated and Anticorrelated Brain Networks , 2012, Brain Connect..

[56]  M. Costantini,et al.  Haptic perception and body representation in lateral and medial occipito-temporal cortices , 2011, Neuropsychologia.

[57]  J. Haxby,et al.  Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements , 2002, Neuron.

[58]  Galit Yovel,et al.  An Integrated Face–Body Representation in the Fusiform Gyrus but Not the Lateral Occipital Cortex , 2014, Journal of Cognitive Neuroscience.

[59]  Alison J. Wiggett,et al.  Surface-Based Information Mapping Reveals Crossmodal Vision–Action Representations in Human Parietal and Occipitotemporal Cortex , 2010, Journal of neurophysiology.

[60]  P. Downing,et al.  The neural basis of visual body perception , 2007, Nature Reviews Neuroscience.

[61]  Luca Battaglini,et al.  TMS reveals flexible use of form and motion cues in biological motion perception , 2016, Neuropsychologia.