Differences in fMRI intersubject correlation while viewing unedited and edited videos of dance performance

Intersubject correlation (ISC) analysis of functional magnetic resonance imaging (fMRI) data provides insight into how continuous streams of sensory stimulation are processed by groups of observers. Although edited movies are frequently used as stimuli in ISC studies, there has been little direct examination of the effect of edits on the resulting ISC maps. In this study we showed 16 observers two audiovisual movie versions of the same dance. In one experimental condition there was a continuous view from a single camera (Unedited condition) and in the other condition there were views from different cameras (Edited condition) that provided close up views of the feet or face and upper body. We computed ISC maps for each condition, as well as created a map that showed the difference between the conditions. The results from the Unedited and Edited maps largely overlapped in the occipital and temporal cortices, although more voxels were found for the Edited map. The difference map revealed greater ISC for the Edited condition in the Postcentral Gyrus, Lingual Gyrus, Precentral Gyrus and Medial Frontal Gyrus, while the Unedited condition showed greater ISC in only the Superior Temporal Gyrus. These findings suggest that the visual changes associated with editing provide a source of correlation in maps obtained from edited film, and highlight the utility of using maps to evaluate the difference in ISC between conditions.

[1]  C R Genovese,et al.  Cortical networks subserving pursuit and saccadic eye movements in humans: An FMRI study , 1999, Human brain mapping.

[2]  Laurent Lamalle,et al.  Functional MRI assessment of orofacial articulators: Neural correlates of lip, jaw, larynx, and tongue movements , 2012, Human brain mapping.

[3]  Richard C. Reynolds,et al.  Sensory stimulation activates both motor and sensory components of the swallowing system , 2008, NeuroImage.

[4]  Thomas E. Nichols,et al.  Controlling the familywise error rate in functional neuroimaging: a comparative review , 2003, Statistical methods in medical research.

[5]  Andreas Bartels,et al.  The chronoarchitecture of the human brain—natural viewing conditions reveal a time-based anatomy of the brain , 2004, NeuroImage.

[6]  D. Rubin,et al.  Comparing Correlated but Nonoverlapping Correlations , 1996 .

[7]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[8]  Vince D Calhoun,et al.  Interparticipant correlations: A model free FMRI analysis technique , 2007, Human brain mapping.

[9]  Emily S. Cross,et al.  Building a motor simulation de novo: Observation of dance by dancers , 2006, NeuroImage.

[10]  Frank E. Pollick,et al.  Experience in judging intent to harm modulates parahippocampal activity: An fMRI study with experienced CCTV operators , 2014, Cortex.

[11]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.

[12]  Mikko Sams,et al.  Inter-Subject Correlation of Brain Hemodynamic Responses During Watching a Movie: Localization in Space and Frequency , 2009, Front. Neuroinform..

[13]  M. Sams,et al.  Inter-Subject Synchronization of Prefrontal Cortex Hemodynamic Activity During Natural Viewing , 2008, The open neuroimaging journal.

[14]  R. Tootell,et al.  An anterior temporal face patch in human cortex, predicted by macaque maps , 2009, Proceedings of the National Academy of Sciences.

[15]  Istvan Molnar-Szakacs,et al.  Beyond superior temporal cortex: intersubject correlations in narrative speech comprehension. , 2008, Cerebral cortex.

[16]  Tim J. Smith,et al.  Watching you watch movies: Using eye tracking to inform cognitive film theory. , 2013 .

[17]  Daniel T. Levin,et al.  A Window on Reality , 2012 .

[18]  F. Pollick,et al.  Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings , 2013, i-Perception.

[19]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[20]  Doris Y. Tsao,et al.  Comparing face patch systems in macaques and humans , 2008, Proceedings of the National Academy of Sciences.

[21]  A. Shimamura,et al.  Psychocinematics: Exploring cognition at the movies. , 2013 .

[22]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[23]  J. Cutting,et al.  Attention and the Evolution of Hollywood Film , 2010, Psychological science.

[24]  Parag Chordia,et al.  Inter‐subject synchronization of brain responses during natural music listening , 2013, The European journal of neuroscience.

[25]  Jeffrey M. Zacks,et al.  Lateral somatotopic organization during imagined and prepared movements. , 2006, Journal of neurophysiology.

[26]  L. Davachi,et al.  Enhanced Intersubject Correlations during Movie Viewing Correlate with Successful Episodic Encoding , 2008, Neuron.

[27]  Uri Hasson,et al.  Shared and idiosyncratic cortical activation patterns in autism revealed under continuous real‐life viewing conditions , 2009, Autism research : official journal of the International Society for Autism Research.

[28]  Jukka-Pekka Kauppi,et al.  Inter-Subject Correlation in fMRI: Method Validation against Stimulus-Model Based Analysis , 2012, PloS one.

[29]  J. Gallant,et al.  Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies , 2011, Current Biology.

[30]  Frank E. Pollick,et al.  Motor Simulation without Motor Expertise: Enhanced Corticospinal Excitability in Visually Experienced Dance Spectators , 2012, PloS one.

[31]  Thomas Martinetz,et al.  Variability of eye movements when viewing dynamic natural scenes. , 2010, Journal of vision.

[32]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[33]  Simon B Eickhoff,et al.  Brain regions involved in human movement perception: A quantitative voxel‐based meta‐analysis , 2012, Human brain mapping.

[34]  Mikko Sams,et al.  Mental Action Simulation Synchronizes Action–Observation Circuits across Individuals , 2014, The Journal of Neuroscience.

[35]  John M. Henderson,et al.  Clustering of Gaze During Dynamic Scene Viewing is Predicted by Motion , 2011, Cognitive Computation.

[36]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[37]  Vince D. Calhoun,et al.  A method for multi-group inter-participant correlation: Abnormal synchrony in patients with schizophrenia during auditory target detection , 2008, NeuroImage.

[38]  Jussi Tohka,et al.  A versatile software package for inter-subject correlation based analyses of fMRI , 2014, Front. Neuroinform..

[39]  Sonja A. Kotz,et al.  Functional dissociation of pre-SMA and SMA-proper in temporal processing , 2012, NeuroImage.

[40]  D. Heeger,et al.  Neurocinematics: The Neuroscience of Film , 2008 .

[41]  Rainer Goebel,et al.  Common neural substrates for visual working memory and attention , 2007, NeuroImage.

[42]  Guillén Fernández,et al.  Persistent schema-dependent hippocampal-neocortical connectivity during memory encoding and postencoding rest in humans , 2010, Proceedings of the National Academy of Sciences.

[43]  Jessica F. Cantlon,et al.  Neural Activity during Natural Viewing of Sesame Street Statistically Predicts Test Scores in Early Childhood , 2013, PLoS biology.

[44]  Hugo D Critchley,et al.  Imitating expressions: emotion-specific neural substrates in facial mimicry. , 2006, Social cognitive and affective neuroscience.

[45]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[46]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.