The Impact of Continuity Editing in Narrative Film on Event Segmentation

Filmmakers use continuity editing to engender a sense of situational continuity or discontinuity at editing boundaries. The goal of this study was to assess the impact of continuity editing on how people perceive the structure of events in a narrative film and to identify brain networks that are associated with the processing of different types of continuity editing boundaries. Participants viewed a commercially produced film and segmented it into meaningful events, while brain activity was recorded with functional magnetic resonance imaging (MRI). We identified three degrees of continuity that can occur at editing locations: edits that are continuous in space, time, and action; edits that are discontinuous in space or time but continuous in action; and edits that are discontinuous in action as well as space or time. Discontinuities in action had the biggest impact on behavioral event segmentation, and discontinuities in space and time had minor effects. Edits were associated with large transient increases in early visual areas. Spatial-temporal changes and action changes produced strikingly different patterns of transient change, and they provided evidence that specialized mechanisms in higher order perceptual processing regions are engaged to maintain continuity of action in the face of spatiotemporal discontinuities. These results suggest that commercial film editing is shaped to support the comprehension of meaningful events that bridge breaks in low-level visual continuity, and even breaks in continuity of spatial and temporal location.

[1]  W. Murch.  In the blink of an eye : a perspective on film editing , 2001 .

[2]  William F. Brewer,et al.  Story structure, characterization, just world organization, and reader affect in American and Hungarian short stories☆ , 1988 .

[3]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[4]  Jeffrey M. Zacks,et al.  Human Brain Activity Time-Locked to Narrative Event Boundaries , 2007, Psychological science.

[5]  Steven A. Hillyard,et al.  V1, V2, and V4 of Macaque Visual Cortex Neural Mechanisms of Spatial Selective Attention in Areas , 2013 .

[6]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[7]  Filip Germeys,et al.  The psychology of film: perceiving beyond the cut , 2007, Psychological research.

[8]  J. Gabrieli,et al.  Neural Correlates of Encoding Space from Route and Survey Perspectives , 2002, The Journal of Neuroscience.

[9]  Jeffrey M. Zacks,et al.  Segmentation in reading and film comprehension. , 2009, Journal of experimental psychology. General.

[10]  Jeffrey M. Zacks,et al.  The Brain's Cutting-Room Floor: Segmentation of Narrative Cinema , 2010, Front. Hum. Neurosci..

[11]  Stephan Schwan,et al.  Watching Film for the First Time , 2010, Psychological science.

[12]  Darren Newtson.  Attribution and the unit of perception of ongoing behavior. , 1973 .

[13]  Jeffrey M. Zacks,et al.  Event Segmentation , 2007, Current directions in psychological science.

[14]  William F. Brewer,et al.  Discourse Organization in the Comprehension of Temporal Order in , 1992 .

[15]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[16]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[17]  Peter Dixon,et al.  Psychonarratology: Foundations for the Empirical Study of Literary Response , 2002 .

[18]  T G Bever,et al.  Segmentation in cinema perception. , 1976, Science.

[19]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[20]  Jeffrey M. Zacks,et al.  Segmentation in the perception and memory of events , 2008, Trends in Cognitive Sciences.

[21]  K. Grill-Spector,et al.  fMR-adaptation: a tool for studying the functional properties of human cortical neurons. , 2001, Acta psychologica.

[22]  Jeffery. M. Zacks,et al.  Activation of human motion processing areas during event perception , 2003, Cognitive, affective & behavioral neuroscience.

[23]  Scott T Grafton,et al.  Repetition suppression for performed hand gestures revealed by fMRI , 2009, Human brain mapping.

[24]  Roger J. Kreuz,et al.  Empirical Approaches to Literature and Aesthetics , 1996 .

[25]  Russell A. Epstein.  Parahippocampal and retrosplenial contributions to human spatial navigation , 2008, Trends in Cognitive Sciences.

[26]  Darren Newtson,et al.  The perceptual organization of ongoing behavior , 1976 .

[27]  B. Velichkovsky,et al.  Eye typing in application: A comparison of two interfacing systems with ALS patients , 2008 .

[28]  David Bordwell,et al.  Intensified Continuity Visual Style in Contemporary American Film , 2002 .

[29]  Alex Martin,et al.  NEURAL FOUNDATIONS FOR UNDERSTANDING SOCIAL AND MECHANICAL CONCEPTS , 2003, Cognitive neuropsychology.

[30]  N. Troje,et al.  Person identification from biological motion: Effects of structural and kinematic cues , 2005, Perception & psychophysics.

[31]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[32]  Stephan P. Swinnen,et al.  Is the human primary motor cortex activated by muscular or direction-dependent features of observed movements? , 2009, Cortex.

[33]  G. Barsh,et al.  Effects of Hypothalamic Neurodegeneration on Energy Balance , 2005, PLoS biology.

[34]  Jeffrey M. Zacks,et al.  Reading Stories Activates Neural Representations of Visual and Motor Experiences , 2009, Psychological science.

[35]  Jeffrey M. Zacks,et al.  Event perception: a mind-brain perspective. , 2007, Psychological bulletin.

[36]  Morton Ann Gernsbacher,et al.  Language Comprehension As Structure Building , 1990 .

[37]  J. Mazziotta,et al.  Grasping the Intentions of Others with One's Own Mirror Neuron System , 2005, PLoS biology.

[38]  Joseph P. Magliano,et al.  When goals collide: Monitoring the goals of multiple characters , 2005, Memory & cognition.

[39]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[40]  Rolf A. Zwaan,et al.  Indexing space and time in film understanding , 2001 .

[41]  Rolf A. Zwaan,et al.  Generating predictive inferences while viewing a movie , 1996 .

[42]  Arthur C. Graesser,et al.  Verification of Statements about Story Worlds That Deviate from Normal Conceptions of Time: What Is True aboutEinstein's Dreams? , 1998, Cognitive Psychology.

[43]  B. Balas,et al.  Personal Familiarity Influences the Processing of Upright and Inverted Faces in Infants , 2009, Front. Hum. Neurosci..

[44]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[45]  J. Cutting,et al.  Attention and the Evolution of Hollywood Film , 2010, Psychological science.

[46]  T. Trabasso,et al.  Understanding text: Achieving explanatory coherence through on‐line inferences and mental operations in working memory , 1993 .

[47]  Nava Rubin,et al.  Brain areas selective for both observed and executed movements. , 2007, Journal of neurophysiology.

[48]  P. Strick,et al.  Motor areas of the medial wall: a review of their location and functional activation. , 1996, Cerebral cortex.

[49]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[50]  Robert N. Kraft,et al.  The role of cutting in the evaluation and retention of film. , 1986 .

[51]  E. Tan.  Emotion and the structure of narrative film , 1996 .

[52]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[53]  C. Frith.  The social brain? , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[54]  T. Trabasso,et al.  Logical necessity and transitivity of causal relations in stories , 1989 .

[55]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[56]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[57]  R. Buckner,et al.  Cluster size thresholds for assessment of significant activation in fMRI , 2001, NeuroImage.

[58]  Rolf A. Zwaan,et al.  The Construction of Situation Models in Narrative Comprehension: An Event-Indexing Model , 1995 .

[59]  Rafael Malach,et al.  Vision Intersubject Synchronization of Cortical Activity During Natural , 2011 .

[60]  J. Henderson,et al.  Edit Blindness: The relationship between attention and global change blindness in dynamic scenes. , 2008 .

[61]  David Bordwell.  Narration in the Fiction Film , 1985 .

[62]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[63]  Tilo Kircher,et al.  Neural correlates of narrative shifts during auditory story comprehension , 2009, NeuroImage.

[64]  Ken Dancyger,et al.  The Technique of Film and Video Editing: History, Theory, and Practice , 1993 .

[65]  T. Heatherton,et al.  Detecting agency from the biological motion of veridical vs animated agents. , 2007, Social cognitive and affective neuroscience.

[66]  Julian Hochberg,et al.  Chapter 6 – The Perception of Motion Pictures , 1996 .

[67]  Arthur C. Graesser,et al.  The role of situational continuity in narrative understanding. , 1999 .

[68]  Jean M. Vettel,et al.  Visual motion and the neural correlates of event perception , 2006, Brain Research.

[69]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[70]  F. Hesse,et al.  Do film cuts facilitate the perceptual and cognitive organization of activitiy sequences? , 2000, Memory & cognition.