Event structure in perception and conception.

Events can be understood in terms of their temporal structure. The authors first draw on several bodies of research to construct an analysis of how people use event structure in perception, understanding, planning, and action. Philosophy provides a grounding for the basic units of events and actions. Perceptual psychology provides an analogy to object perception: Like objects, events belong to categories, and, like objects, events have parts. These relationships generate 2 hierarchical organizations for events: taxonomies and partonomies. Event partonomies have been studied by looking at how people segment activity as it happens. Structured representations of events can relate partonomy to goal relationships and causal structure; such representations have been shown to drive narrative comprehension, memory, and planning. Computational models provide insight into how mental representations might be organized and transformed. These different approaches to event structure converge on an explanation of how multiple sources of information interact in event perception and conception.

[1]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[2]  L. Frank The Society for Research in Child Development , 1935 .

[3]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[4]  R. Barker,et al.  Midwest and its children: the psychological ecology of an American town. , 1954 .

[5]  R. C. Oldfield THE PERCEPTION OF CAUSALITY , 1963 .

[6]  Roger G. Barker,et al.  The Stream of Behavior as an Empirical Problem. , 1963 .

[7]  Harold R. Dickman,et al.  The Perception of Behavioral Units. , 1963 .

[8]  R. Barker,et al.  The Stream of Behavior , 1965 .

[9]  R. Hursthouse THE LOGIC OF DECISION AND ACTION , 1969 .

[10]  A. Goldman Theory of Human Action , 1970 .

[11]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[12]  Darren Newtson Attribution and the unit of perception of ongoing behavior. , 1973 .

[13]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[14]  Leonard Talmy,et al.  Semantics and syntax of motion , 1975 .

[15]  D. Bobrow,et al.  Representation and Understanding: Studies in Cognitive Science , 1975 .

[16]  D. Rumelhart NOTES ON A SCHEMA FOR STORIES , 1975 .

[17]  Jaegwon Kim,et al.  Events as Property Exemplifications , 1976 .

[18]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[19]  G. Miller,et al.  Language and Perception , 1976 .

[20]  Darren Newtson,et al.  The perceptual organization of ongoing behavior , 1976 .

[21]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[22]  Darren Newtson,et al.  The objective basis of behavior units. , 1977 .

[23]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[24]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[25]  Terence E Horgan The Case Against Events , 1978 .

[26]  Richard C. Anderson,et al.  Schooling and the Acquisition of Knowledge , 1978 .

[27]  David A. Wilder,et al.  Effect of Predictability on Units of Perception and Attribution , 1978 .

[28]  David A. Wilder,et al.  Predictability of Behaviors, Goals, and Unit of Perception , 1978 .

[29]  Roger C. Schank Computer understanding of natural language , 1978 .

[30]  Ebbe B. Ebbesen,et al.  Observational goals and schema activation: A theoretical framework for behavior perception , 1979 .

[31]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[32]  John B. Black,et al.  Scripts in memory for text , 1979, Cognitive Psychology.

[33]  William F. Brewer,et al.  Memory for goal-directed events , 1980, Cognitive Psychology.

[34]  Bertram C. Bruce,et al.  Theoretical issues in reading comprehension : perspectives from cognitive psychology, linguistics, artificial intelligence, and education , 1980 .

[35]  R. Hastie Person memory : the cognitive basis of social perception , 1980 .

[36]  L. Jacoby Memory as cognition. , 1980, Science.

[37]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[38]  R. Abelson Psychological status of the script concept. , 1981 .

[39]  R. Schank,et al.  Inside Computer Understanding: Five Programs Plus Miniatures , 1982 .

[40]  Peter M. S. Hacker,et al.  Events, Ontology and Grammar , 1982, Philosophy.

[41]  G. Bower Plans and Goals in Understanding Episodes , 1982 .

[42]  W. Kintsch,et al.  Strategies of discourse comprehension , 1986 .

[43]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[44]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[45]  William F. Brewer,et al.  Use of plan schemata in the recall and recognition of goal-directed actions. , 1983 .

[46]  B. Tversky,et al.  Journal of Experimental Psychology : General VOL . 113 , No . 2 JUNE 1984 Objects , Parts , and Categories , 2005 .

[47]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[48]  Irving Biederman,et al.  Human image understanding: Recent research and a theory , 1985, Comput. Vis. Graph. Image Process..

[49]  John B. Black,et al.  The representation of scripts in memory , 1985 .

[50]  A. Rifkin,et al.  Evidence for a basic level in event taxonomies , 1985, Memory & cognition.

[51]  Robert H. Thibadeau,et al.  Artificial Perception of Actions , 1986, Cogn. Sci..

[52]  K. Nelson,et al.  Event knowledge : structure and function in development , 1986 .

[53]  Terry Winograd,et al.  Understanding computers and cognition , 1986 .

[54]  Action identification in the emergence of social behavior. , 1986 .

[55]  Darren Newtson,et al.  The Structure of Action and Interaction , 1987 .

[56]  Robin R. Vallacher,et al.  What do people think they're doing? Action identification and human behavior. , 1987 .

[57]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[58]  William G. Graziano,et al.  Social Cognition as Segmentation of the Stream of Behavior. , 1988 .

[59]  E. Lepore,et al.  Actions and Events: Perspectives on the Philosophy of Donald Davidson , 1988 .

[60]  N. Sharkey,et al.  Advances in cognitive science , 1988 .

[61]  Judith Hudson Children's memory for atypical actions in script-based stories: Evidence for a disruption effect , 1988 .

[62]  Gordon H. Bower,et al.  Retrieving actions from goal hierarchies , 1988 .

[63]  Mark Steedman,et al.  Temporal Ontology and Temporal Reference , 1988, CL.

[64]  Scott L. Rogers,et al.  Memorial consequences of variation in behavior perception , 1988 .

[65]  Susan T. Dumais,et al.  Improving information retrieval using latent semantic indexing , 1988 .

[66]  Leonard Talmy,et al.  Force Dynamics in Language and Cognition , 1987, Cogn. Sci..

[67]  W Hirst,et al.  On the representation of events: a study of orientation, recall, and recognition. , 1989, Journal of experimental psychology. General.

[68]  S. Brison The Intentional Stance , 1989 .

[69]  J. Mandler,et al.  One thing follows another: Effects of temporal structure on 1- to 2-year-olds' recall of events. , 1989 .

[70]  G Sperling,et al.  Intelligent temporal subsampling of American Sign Language using event boundaries. , 1990, Journal of experimental psychology. Human perception and performance.

[71]  Savas Tsohatsidis Meanings and prototypes : studies in linguistic categorization , 1990 .

[72]  G. Murphy,et al.  Converging operations on a basic level in event taxonomies , 1990, Memory & cognition.

[73]  G. Daniel Lassiter,et al.  The unitization and memory of events , 1991 .

[74]  W. Hirst,et al.  Recognizing differences in recognition tasks: A reply to Lassiter and Slaw. , 1991 .

[75]  James Pustejovsky,et al.  The syntax of event structure , 1991, Cognition.

[76]  Behavior research methods, instruments, & computers , 1991 .

[77]  M. Boltz,et al.  The remembering of auditory event durations. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[78]  M Boltz,et al.  Temporal accent structure and the remembering of filmed narratives. , 1992, Journal of experimental psychology. Human perception and performance.

[79]  A. D. Manning,et al.  Understanding Comics: The Invisible Art , 1993 .

[80]  Y. Kareev,et al.  The emergence of events , 1994, Cognition.

[81]  Amy L. Lansky Action-based Planning , 1994, AIPS.

[82]  Nancy L. Stein,et al.  Using goal-plan knowledge to merge the past with the present and the future in narrating events on line. , 1994 .

[83]  Bruce F. Pennington,et al.  The development of future-oriented processes , 1994 .

[84]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[85]  Rolf A. Zwaan,et al.  The Construction of Situation Models in Narrative Comprehension: An Event-Indexing Model , 1995 .

[86]  A. Meltzoff Understanding the Intentions of Others: Re-Enactment of Intended Acts by 18-Month-Old Children. , 1995, Developmental psychology.

[87]  M G Boltz Effects of event structure on retrospective duration judgments , 1995, Perception & psychophysics.

[88]  M. Tarr Rotating objects to recognize them: A case study on the role of viewpoint dependency in the recognition of three-dimensional objects , 1995, Psychonomic bulletin & review.

[89]  R. Shillcock,et al.  Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society , 1995 .

[90]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[91]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[92]  Paul Hemeren,et al.  Frequency, ordinal position and semantic distance as measures of cross-cultural stability and hierarchies for action verbs , 1996 .

[93]  Karen Wynn,et al.  Infants' Individuation and Enumeration of Actions , 1996 .

[94]  P. van den Broek,et al.  Children's and adults' memory for television stories: the role of causal factors, story-grammar categories, and hierarchical level. , 1996, Child development.

[95]  Catherine Hanson,et al.  Development of Schemata during Event Parsing: Neisser's Perceptual Cycle as a Recurrent Connectionist Network , 1996, Journal of Cognitive Neuroscience.

[96]  E. Newport,et al.  WORD SEGMENTATION : THE ROLE OF DISTRIBUTIONAL CUES , 1996 .

[97]  D. Gentner,et al.  What language might tell us about the perception of cause , 1996 .

[98]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[99]  E. Newport,et al.  PSYCHOLOGICAL SCIENCE Research Article INCIDENTAL LANGUAGE LEARNING: Ustening (and Learning) out of the Comer of Your Ear , 2022 .

[100]  Talking the Talk is Like Walking the Walk : A Computational Model of Verbal Aspect , 1997 .

[101]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[102]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[103]  Karen Wynn,et al.  Limits to Infants' Knowledge of Objects: The Case of Magical Appearance , 1998 .

[104]  Rolf A. Zwaan,et al.  Retrieval from temporally organized situation models. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[105]  A. Woodward Infants selectively encode the goal object of an actor's reach , 1998, Cognition.

[106]  R. Byrne Imitation without intentionality. Using string parsing to copy the organization of behaviour , 1999, Animal Cognition.

[107]  M. Brent,et al.  On the discovery of novel wordlike units from utterances: an artificial-language study with implications for native-language acquisition. , 1999, Journal of experimental psychology. General.

[108]  J. Sommerville,et al.  Twelve-Month-Old Infants Interpret Action in Context , 2000, Psychological science.

[109]  Gillian Cohen,et al.  Hierarchical models in cognition: Do they have psychological reality? , 2000 .

[110]  A. Chemero What Events Are , 2000 .

[111]  Yong Rui,et al.  Segmenting visual actions based on spatio-temporal motion patterns , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[112]  Jeffrey M. Zacks,et al.  Perceiving, remembering, and communicating structure in events. , 2001, Journal of experimental psychology. General.

[113]  Jodie A. Baird,et al.  Infants parse dynamic action. , 2001, Child development.

[114]  David L. Davidson,et al.  The Logical Form of Action Sentences , 2001 .