Event perception: a mind-brain perspective.

People perceive and conceive of activity in terms of discrete events. Here the authors propose a theory according to which the perception of boundaries between events arises from ongoing perceptual processing and regulates attention and memory. Perceptual systems continuously make predictions about what will happen next. When transient errors in predictions arise, an event boundary is perceived. According to the theory, the perception of events depends on both sensory cues and knowledge structures that represent previously learned information about event parts and inferences about actors' goals and plans. Neurological and neurophysiological data suggest that representations of events may be implemented by structures in the lateral prefrontal cortex and that perceptual prediction error is calculated and evaluated by a processing pathway, including the anterior cingulate cortex and subcortical neuromodulatory systems.

[1]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[3]  C. Stendler One Boy's Day: A Specimen Record of Behavior. , 1952 .

[4]  Darren Newtson Attribution and the unit of perception of ongoing behavior. , 1973 .

[5]  D. Bobrow,et al.  Representation and Understanding: Studies in Cognitive Science , 1975 .

[6]  D. Rumelhart NOTES ON A SCHEMA FOR STORIES , 1975 .

[7]  M. Posner,et al.  Attention and cognitive control. , 1975 .

[8]  J. Harvey,et al.  New Directions in Attribution Research , 2018 .

[9]  Darren Newtson,et al.  The perceptual organization of ongoing behavior , 1976 .

[10]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[11]  Darren Newtson,et al.  The objective basis of behavior units. , 1977 .

[12]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[13]  W. Kintsch,et al.  Memory and cognition , 1977 .

[14]  David A. Wilder,et al.  Effect of Predictability on Units of Perception and Attribution , 1978 .

[15]  David A. Wilder,et al.  Predictability of Behaviors, Goals, and Unit of Perception , 1978 .

[16]  John B. Black,et al.  Scripts in memory for text , 1979, Cognitive Psychology.

[17]  William F. Brewer,et al.  Memory for goal-directed events , 1980, Cognitive Psychology.

[18]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[19]  Bertram C. Bruce,et al.  Theoretical issues in reading comprehension : perspectives from cognitive psychology, linguistics, artificial intelligence, and education , 1980 .

[20]  R. Abelson Psychological status of the script concept. , 1981 .

[21]  O. Andy The prefrontal cortex: Anatomy, physiology and neuropsychology of the frontal lobe , 1981 .

[22]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[23]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[24]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[25]  J. Grafman,et al.  Forms of memory failure. , 1983, Science.

[26]  William F. Brewer,et al.  Use of plan schemata in the recall and recognition of goal-directed actions. , 1983 .

[27]  John B. Black,et al.  The representation of scripts in memory , 1985 .

[28]  R. Waziri Fundamentals of Human Neuropsychology, 2nd ed , 1986 .

[29]  Scott L. Rogers,et al.  Memorial consequences of variation in behavior perception , 1988 .

[30]  G. Lassiter Behavior Perception, Affect, and Memory , 1988 .

[31]  W Hirst,et al.  On the representation of events: a study of orientation, recall, and recognition. , 1989, Journal of experimental psychology. General.

[32]  M. Posner Foundations of cognitive science , 1989 .

[33]  Bryan Kolb,et al.  Fundamentals of human neuropsychology, 3rd ed. , 1990 .

[34]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[35]  G. Daniel Lassiter,et al.  The unitization and memory of events , 1991 .

[36]  W. Hirst,et al.  Recognizing differences in recognition tasks: A reply to Lassiter and Slaw. , 1991 .

[37]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[38]  Herbert Weingartner,et al.  Script generation as an indicator of knowledge representation in patients with Alzheimer's disease , 1991, Brain and Language.

[39]  J M Fuster,et al.  The prefrontal cortex and its relation to behavior. , 1991, Progress in brain research.

[40]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[41]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[42]  M Boltz,et al.  Temporal accent structure and the remembering of filmed narratives. , 1992, Journal of experimental psychology. Human perception and performance.

[43]  Y. Kareev,et al.  The emergence of events , 1994, Cognition.

[44]  Carol A. Seger,et al.  Implicit learning. , 1994, Psychological bulletin.

[45]  W. Kintsch Text comprehension, memory, and learning. , 1994, The American psychologist.

[46]  Arthur C. Graesser,et al.  Dimensions of situation model construction in narrative comprehension. , 1995 .

[47]  I. Whishaw,et al.  Fundamentals of Human Neuropsychology , 1995 .

[48]  JORDAN GRAFMAN,et al.  Similarities and Distinctions among Current Models of Prefrontal Cortical Functions , 1995, Annals of the New York Academy of Sciences.

[49]  Michael W. Montgomery,et al.  The quantitative description of action disorganisation after brain damage: a case study , 1991 .

[50]  MYRNA F. SCHWARTZ,et al.  Re‐examining the Role of Executive Functions in Routine Action Production a , 1995, Annals of the New York Academy of Sciences.

[51]  Jordan Grafman,et al.  Selective Impairments in Managerial Knowledge Following Pre-Frontal Cortex Damage , 1995, Cortex.

[52]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[53]  A. Meltzoff Understanding the Intentions of Others: Re-Enactment of Intended Acts by 18-Month-Old Children. , 1995, Developmental psychology.

[54]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[55]  Michael W. Montgomery,et al.  Analysis of a disorder of everyday action , 1995 .

[56]  J. Grafman,et al.  Fables of the prefrontal cortex , 1995, Behavioral and Brain Sciences.

[57]  R. Andersen,et al.  Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  P. Strick,et al.  Motor areas of the medial wall: a review of their location and functional activation. , 1996, Cerebral cortex.

[59]  B. Hommel The Perception of Action and Movement , 1996 .

[60]  N. Sadato,et al.  Brain activation during script event processing , 1996, Neuroreport.

[61]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[62]  Rolf A. Zwaan Processing Narrative Time Shifts , 1996 .

[63]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[64]  Catherine Hanson,et al.  Development of Schemata during Event Parsing: Neisser's Perceptual Cycle as a Recurrent Connectionist Network , 1996, Journal of Cognitive Neuroscience.

[65]  Jordan Grafman,et al.  Encoding of Sequence and Boundaries of Scripts Following Prefrontal Lesions , 1996, Cortex.

[66]  R. O’Reilly,et al.  A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challenges. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[67]  W. Prinz Perception and Action Planning , 1997 .

[68]  D. Weinberger,et al.  Dopamine, the prefrontal cortex and schizophrenia , 1997, Journal of psychopharmacology.

[69]  Michael W. Montgomery,et al.  Naturalistic action impairment in closed head injury. , 1998, Neuropsychology.

[70]  A. Sirigu,et al.  Deficit in Evaluating Pre-Determinated Sequences of Script Events in Patients with Parkinson's Disease , 1998, Cortex.

[71]  A. Nobre,et al.  Where and When to Pay Attention: The Neural Systems for Directing Attention to Spatial Locations and to Time Intervals as Revealed by Both PET and fMRI , 1998, The Journal of Neuroscience.

[72]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[73]  G. Humphreys,et al.  Disordered action schema and action disorganisation syndrome , 1998 .

[74]  Arthur C. Graesser,et al.  Narrative Comprehension, Causality, and Coherence : Essays in Honor of Tom Trabasso , 1999 .

[75]  E. Maguire,et al.  The functional neuroanatomy of comprehension and memory: the importance of prior knowledge. , 1999, Brain : a journal of neurology.

[76]  Rolf A. Zwaan Five dimensions of narrative comprehension: The event-indexing model. , 1999 .

[77]  S. Grossberg The Link between Brain Learning, Attention, and Consciousness , 1999, Consciousness and Cognition.

[78]  A. Trillingsgaard,et al.  The script model in relation to autism , 1999, European Child & Adolescent Psychiatry.

[79]  D. Le Gall,et al.  Mental representation of knowledge following frontal-lobe lesion: dissociations on tasks using scripts. , 1999, Journal of clinical and experimental neuropsychology.

[80]  Colin M. Brown,et al.  Semantic Integration in Sentences and Discourse: Evidence from the N400 , 1999, Journal of Cognitive Neuroscience.

[81]  M. Kutas,et al.  Semantic integration in reading: engagement of the right hemisphere during discourse processing. , 1999, Brain : a journal of neurology.

[82]  Stéphane Lehéricy,et al.  Distinct prefrontal activations in processing sequence at the sentence and script level: An fMRI study , 1999, Neuropsychologia.

[83]  J. Cohen,et al.  The role of locus coeruleus in the regulation of cognitive performance. , 1999, Science.

[84]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[85]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.

[86]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[87]  R. Spinks The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe, 3rd ed. , 2000 .

[88]  J. D. E. Gabrieli,et al.  Integration of diverse information in working memory within the frontal lobe , 2000, Nature Neuroscience.

[89]  F. Hesse,et al.  Do film cuts facilitate the perceptual and cognitive organization of activitiy sequences? , 2000, Memory & cognition.

[90]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[91]  D. Plaut,et al.  Doing Without Schema Hierarchies : A Recurrent Connectionist Approach to Routine Sequential Action and Its Pathologies , 2000 .

[92]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[93]  G. Bower,et al.  Temporal and spatial distance in situation models , 2000, Memory & cognition.

[94]  Jonathan D. Cohen,et al.  Anterior cingulate and prefrontal cortex: who's in control? , 2000, Nature Neuroscience.

[95]  E. Procyk,et al.  Anterior cingulate activity during routine and non-routine sequential behaviors in macaques , 2000, Nature Neuroscience.

[96]  D. A. Robertson,et al.  Functional Neuroanatomy of the Cognitive Process of Mapping During Discourse Comprehension , 2000, Psychological science.

[97]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[98]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[99]  Jeffrey M. Zacks,et al.  Perceiving, remembering, and communicating structure in events. , 2001, Journal of experimental psychology. General.

[100]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[101]  Evelyn C. Ferstl,et al.  The role of coherence and cohesion in text comprehension: an event-related fMRI study. , 2001, Brain research. Cognitive brain research.

[102]  G. Bower,et al.  Selecting one among many referents in spatial situation models. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[103]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[104]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[105]  Dare A. Baldwin,et al.  Intentions and Intentionality: Foundations of Social Cognition , 2001 .

[106]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[107]  Anna Christina Nobre,et al.  Orienting attention to instants in time , 2001, Neuropsychologia.

[108]  Jodie A. Baird,et al.  Making sense of human behavior: Action parsing and intentional inference , 2001 .

[109]  Jim Austin,et al.  Emergent Neural Computational Architectures Based on Neuroscience: Towards Neuroscience-Inspired Computing , 2001 .

[110]  Stephen Jose Hanson,et al.  Connectionist Neuroimaging , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[111]  V. Gallese The 'shared manifold' hypothesis: From mirror neurons to empathy. , 2001 .

[112]  Nicolas P. Rougier,et al.  Learning representations in a gated prefrontal cortex model of dynamic task switching , 2002, Cogn. Sci..

[113]  J. Decety,et al.  Distinct Areas in Parietal Cortex Involved in Long-Term and Short-Term Action Planning: A Pet Investigation , 2002, Cortex.

[114]  Heikki Lyytinen,et al.  The Orienting Response in Information Processing , 2002 .

[115]  Rolf A. Zwaan,et al.  Language Comprehenders Mentally Represent the Shapes of Objects , 2002, Psychological science.

[116]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[117]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[118]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[119]  Jonathan D. Cohen,et al.  Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. , 2002, Cerebral cortex.

[120]  E. Koechlin,et al.  Medial Prefrontal and Subcortical Mechanisms Underlying the Acquisition of Motor and Cognitive Action Sequences in Humans , 2002, Neuron.

[121]  Evelyn C. Ferstl,et al.  What Does the Frontomedian Cortex Contribute to Language Processing: Coherence or Theory of Mind? , 2002, NeuroImage.

[122]  J. Gabrieli,et al.  Neural Correlates of Encoding Space from Route and Survey Perspectives , 2002, The Journal of Neuroscience.

[123]  P. Holcomb,et al.  Event-related potentials during discourse-level semantic integration of complex pictures. , 2002, Brain research. Cognitive brain research.

[124]  Myrna F. Schwartz,et al.  The Naturalistic Action Test: A standardised assessment for everyday action impairment , 2002 .

[125]  D. Plaut,et al.  Representing task context: proposals based on a connectionist model of action , 2002, Psychological research.

[126]  Barbara Tversky,et al.  Structuring information interfaces for procedural learning. , 2003, Journal of experimental psychology. Applied.

[127]  J. Haxby,et al.  fMRI Responses to Video and Point-Light Displays of Moving Humans and Manipulable Objects , 2003, Journal of Cognitive Neuroscience.

[128]  J. Grafman,et al.  Human prefrontal cortex: processing and representational perspectives , 2003, Nature Reviews Neuroscience.

[129]  Michael P. Kaschak,et al.  Neuroimaging studies of language production and comprehension. , 2003, Annual review of psychology.

[130]  Colin M. Brown,et al.  When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. , 2003, Brain research. Cognitive brain research.

[131]  D. Yves von Cramon,et al.  The functional neuroanatomy of human working memory revisited Evidence from 3-T fMRI studies using classical domain-specific interference tasks , 2003, NeuroImage.

[132]  L. Jiménez Attention and implicit learning , 2003 .

[133]  Jeffery. M. Zacks,et al.  Activation of human motion processing areas during event perception , 2003, Cognitive, affective & behavioral neuroscience.

[134]  R. Ivry,et al.  Neural structures that support implicit sequence learning , 2003 .

[135]  Phillip J Holcomb,et al.  Semantic integration in videos of real-world events: an electrophysiological investigation. , 2003, Psychophysiology.

[136]  Jordan Grafman,et al.  Brain activation in processing temporal sequence: an fMRI study , 2004, NeuroImage.

[137]  S. Schwan,et al.  The cognitive representation of filmic event summaries , 2004 .

[138]  Jeffrey M. Zacks,et al.  Using movement and intentions to understand simple events , 2004, Cogn. Sci..

[139]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[140]  D. Tucker,et al.  Frontal and posterior sources of event-related potentials in semantic comprehension. , 2004, Brain research. Cognitive brain research.

[141]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[142]  Michael R. Brent,et al.  An Efficient, Probabilistically Sound Algorithm for Segmentation and Word Discovery , 1999, Machine Learning.

[143]  A. Sirigu,et al.  Perception of dynamic action in patients with schizophrenia , 2004, Psychiatry Research.

[144]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[145]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[146]  D. Plaut,et al.  Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. , 2004, Psychological review.

[147]  Jonathan D. Cohen,et al.  Prefrontal cortex and flexible cognitive control: rules without symbols. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[148]  Jeffrey M. Zacks,et al.  Temporal changes as event boundaries: Processing and memory consequences of narrative time shifts , 2005 .

[149]  S. Sara,et al.  Network reset: a simplified overarching theory of locus coeruleus noradrenaline function , 2005, Trends in Neurosciences.

[150]  Jean M. Vettel,et al.  Visual motion and the neural correlates of event perception , 2006, Brain Research.

[151]  S. Grossberg Adaptive Resonance Theory , 2006 .

[152]  B. Tversky,et al.  Making sense of abstract events: Building event schemas , 2006, Memory & cognition.

[153]  Barbara Tversky,et al.  Perspective taking promotes action understanding and learning. , 2006, Journal of experimental psychology. Human perception and performance.

[154]  B. Tversky,et al.  Hierarchical encoding of behavior: translating perception into action. , 2006, Journal of experimental psychology. General.

[155]  Jeffrey M. Zacks,et al.  Event understanding and memory in healthy aging and dementia of the Alzheimer type. , 2006, Psychology and aging.

[156]  Jeffrey M. Zacks,et al.  Human Brain Activity Time-Locked to Narrative Event Boundaries , 2007, Psychological science.

[157]  P. Holcomb,et al.  In: Understanding Events: How Humans See, Represent, and Act on Events. , 2007 .

[158]  Jeffrey M. Zacks,et al.  A Computational Model of Event Segmentation From Perceptual Prediction , 2007, Cogn. Sci..

[159]  Jonathan D. Cohen,et al.  On the Control of Control: The Role of Dopamine in Regulating Prefrontal Function and Working Memory , 2007 .

[160]  Phillip J. Holcomb,et al.  Neurocognitive Mechanisms of Human Comprehension , 2008 .

[161]  Thomas F. Shipley An Invitation to an Event , 2008 .