"Cuts in Action": A High-Density EEG Study Investigating the Neural Correlates of Different Editing Techniques in Film

In spite of their striking differences with real-life perception, films are perceived and understood without effort. Cognitive film theory attributes this to the system of continuity editing, a system of editing guidelines outlining the effect of different cuts and edits on spectators. A major principle in this framework is the 180° rule, a rule recommendation that, to avoid spectators' attention to the editing, two edited shots of the same event or action should not be filmed from angles differing in a way that expectations of spatial continuity are strongly violated. In the present study, we used high-density EEG to explore the neural underpinnings of this rule. In particular, our analysis shows that cuts and edits in general elicit early ERP component indicating the registration of syntactic violations as known from language, music, and action processing. However, continuity edits and cuts-across the line differ from each other regarding later components likely to be indicating the differences in spatial remapping as well as in the degree of conscious awareness of one's own perception. Interestingly, a time-frequency analysis of the occipital alpha rhythm did not support the hypothesis that such differences in processing routes are mainly linked to visual attention. On the contrary, our study found specific modulations of the central mu rhythm ERD as an indicator of sensorimotor activity, suggesting that sensorimotor networks might play an important role. We think that these findings shed new light on current discussions about the role of attention and embodied perception in film perception and should be considered when explaining spectators' different experience of different kinds of cuts.

[1]  K. R. Ridderinkhof,et al.  Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. , 2001, Psychophysiology.

[2]  S. Koelsch Toward a Neural Basis of Music Perception – A Review and Updated Model , 2011, Front. Psychology.

[3]  B. Renault,et al.  N400-like potentials elicited by faces and knowledge inhibition. , 1996, Brain research. Cognitive brain research.

[4]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[5]  Katrin Heimann,et al.  Moving Mirrors: A High-density EEG Study Investigating the Effect of Camera Movements on Motor Cortex Activation during Action Observation , 2014, Journal of Cognitive Neuroscience.

[6]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[7]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[8]  V. Gallese,et al.  ERP Modulation during Observation of Abstract Paintings by Franz Kline , 2013, PloS one.

[9]  R. Goldstein,et al.  Attention to television: intrastimulus effects of movement and scene changes on alpha variation over time. , 1985, The International journal of neuroscience.

[10]  Joseph P. Magliano,et al.  The Impact of Continuity Editing in Narrative Film on Event Segmentation , 2011, Cogn. Sci..

[11]  Scott T Grafton,et al.  Repetition suppression for performed hand gestures revealed by fMRI , 2009, Human brain mapping.

[12]  M Niedeggen,et al.  Change blindness and time to consciousness , 2001, The European journal of neuroscience.

[13]  G. Rizzolatti,et al.  The Dynamics of Sensorimotor Cortical Oscillations during the Observation of Hand Movements: An EEG Study , 2012, PloS one.

[14]  G Pfurtscheller,et al.  Mu‐rhythm changes in brisk and slow self‐paced finger movements , 1996, Neuroreport.

[15]  Dorothee J. Chwilla,et al.  Monitoring in Language Perception: Mild and Strong Conflicts Elicit Different ERP Patterns , 2010, Journal of Cognitive Neuroscience.

[16]  Seth Geiger,et al.  The Effects of Scene Changes and Semantic Relatedness on Attention to Television , 1993 .

[17]  Vilayanur S. Ramachandran,et al.  EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots , 2007, Neurocomputing.

[18]  G. Pfurtscheller,et al.  Patterns of cortical activation during planning of voluntary movement. , 1989, Electroencephalography and clinical neurophysiology.

[19]  R. Passingham,et al.  Seeing or Doing? Influence of Visual and Motor Familiarity in Action Observation , 2006, Current Biology.

[20]  D. Sammler,et al.  Distinct brain signatures of content and structure violation during action observation , 2015, Neuropsychologia.

[21]  Annie Lang,et al.  The Effects of Related and Unrelated Cuts on Television Viewers' Attention, Processing Capacity, and Memory , 1993 .

[22]  T. Smith The attentional theory of cinematic continuity , 2012 .

[23]  H. Bekkering,et al.  Understanding motor resonance , 2011, Social neuroscience.

[24]  V. Gallese Before and below ‘theory of mind’: embodied simulation and the neural correlates of social cognition , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  David Bordwell Narration in the Fiction Film , 1985 .

[26]  R. Eugeni The lumière galaxy: seven key words for the cinema to come , 2015 .

[27]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[28]  Riccardo Poli,et al.  Event-Related Potentials induced by cuts in feature movies and their exploitation for understanding cut efficacy , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[29]  M. Koivisto,et al.  An ERP study of change detection, change blindness, and visual awareness. , 2003, Psychophysiology.

[30]  J. Hohnsbein,et al.  ERP components on reaction errors and their functional significance: a tutorial , 2000, Biological Psychology.

[31]  Stefan Koelsch,et al.  Shared neural resources between music and language indicate semantic processing of musical tension-resolution patterns. , 2008, Cerebral cortex.

[32]  David I. Perrett,et al.  Event-related potentials and the matching of familiar and unfamiliar faces , 1988, Neuropsychologia.

[33]  Ellen F. Lau,et al.  A cortical network for semantics: (de)constructing the N400 , 2008, Nature Reviews Neuroscience.

[34]  Blake W. Johnson,et al.  Changes in rolandic mu rhythm during observation of a precision grip. , 2004, Psychophysiology.

[35]  R. C. Oldfield THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[36]  Blake W. Johnson,et al.  Mu rhythm modulation during observation of an object-directed grasp. , 2004, Brain research. Cognitive brain research.

[37]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[38]  M. Heil,et al.  Expertise in dance modulates alpha/beta event‐related desynchronization during action observation , 2008, The European journal of neuroscience.

[39]  M. Kiefer,et al.  Error processing and impulsiveness in normals: evidence from event-related potentials. , 2005, Brain research. Cognitive brain research.

[40]  N. Troje,et al.  Exploring motor system contributions to the perception of social information: Evidence from EEG activity in the mu/alpha frequency range , 2010, Social neuroscience.

[41]  Michael Bach,et al.  Ambiguous Figures – What Happens in the Brain When Perception Changes But Not the Stimulus , 2011, Front. Hum. Neurosci..

[42]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[43]  Claudio Del Percio,et al.  Judgment of actions in experts: A high-resolution EEG study in elite athletes , 2009, NeuroImage.

[44]  J. Bruno Debruille,et al.  N300 and Social Affordances: A Study with a Real Person and a Dummy as Stimuli , 2012, PloS one.

[45]  T. Smith An Attentional Theory of Continuity Editing , 2006 .

[46]  Piotr Francuz,et al.  Does the Brain Differentiate Between Related and Unrelated Cuts When Processing Audiovisual Messages? An ERP Study , 2013 .

[47]  Filip Germeys,et al.  The psychology of film: perceiving beyond the cut , 2007, Psychological research.

[48]  V. Gallese,et al.  What is so special about embodied simulation? , 2011, Trends in Cognitive Sciences.

[49]  Stephan Schwan,et al.  Watching Film for the First Time , 2010, Psychological science.

[50]  James E. Cutting,et al.  Perceiving Scenes in Film and in the World , 2001 .

[51]  S. Bentin,et al.  Mirror activity in the human brain while observing hand movements: A comparison between EEG desynchronization in the μ-range and previous fMRI results , 2009, Brain Research.

[52]  G. Pfurtscheller,et al.  Evaluation of event-related desynchronization (ERD) preceding and following voluntary self-paced movement. , 1979, Electroencephalography and clinical neurophysiology.

[53]  Ehud Zohary,et al.  Dissociation between Ventral and Dorsal fMRI Activation during Object and Action Recognition , 2005, Neuron.

[54]  Erich Schröger,et al.  Human Visual System Automatically Encodes Sequential Regularities of Discrete Events , 2010, Journal of Cognitive Neuroscience.

[55]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.