In search of lost time: Reconstructing the unfolding of events from memory

When remembering an event, not only do we recollect what happened, when and where it happened, but also how it unfolded over time. What aspects of events are encoded in memory to support this recollection? This question is central for understanding the nature of event memories and our reconstruction of the time passed. In this article, we investigate how the spontaneous encoding of unfamiliar animations during learning influences the recollection of how these animations unfold. Specifically, we examine two structural properties of dynamic event sequences known to modulate the amount of information encoded in memory: the perceived number of sub-events and their perceived similarity. We found that despite clock duration remaining constant, more sub-events and less similar ones led to longer recognition memory latencies, duration judgments and mental event replaying. In particular, across stimulus animations, both the perceived number of sub-events and their degree of similarity contributed to the prediction of duration judgments and the length of mental event reproductions. Results indicate that the number and nature of sub-events in a sequence modulate how we reconstruct its duration and temporal unfolding, thus suggesting that these event properties, which mediate the amount of information encoded for an event, modulate the subsequent recollection of its temporal unfolding.

[1]  Richard N Aslin,et al.  Bayesian learning of visual chunks by human observers , 2008, Proceedings of the National Academy of Sciences.

[2]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[3]  Kenneth J. Malmberg,et al.  Recognition memory: A review of the critical findings and an integrated theory for relating them , 2008, Cognitive Psychology.

[4]  Jeffrey M. Zacks,et al.  Event perception: a mind-brain perspective. , 2007, Psychological bulletin.

[5]  D. Schacter,et al.  Constructive episodic simulation: Temporal distance and detail of past and future events modulate hippocampal engagement , 2008, Hippocampus.

[6]  A P Yonelinas,et al.  The contribution of recollection and familiarity to recognition and source-memory judgments: a formal dual-process model and an analysis of receiver operating characteristics. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Scott W. Brown,et al.  Attentional processes in time perception: effects of mental workload and event structure. , 2002, Journal of experimental psychology. Human perception and performance.

[8]  Robert L. Goldstone The role of similarity in categorization: providing a groundwork , 1994, Cognition.

[9]  S. Grondin,et al.  From physical time to the first and second moments of psychological time. , 2001, Psychological bulletin.

[10]  R. Block,et al.  Prospective and retrospective duration judgments: A meta-analytic review , 1997, Psychonomic bulletin & review.

[11]  James L. McClelland Incorporating rapid neocortical learning of new schema-consistent information into complementary learning systems theory. , 2013, Journal of experimental psychology. General.

[12]  Gabriel A Radvansky,et al.  Walking through doorways causes forgetting: Situation models and experienced space , 2006, Memory & cognition.

[13]  Francis S. Bellezza,et al.  Chunking of repeated events in memory , 1989 .

[14]  Jeffrey M. Zacks,et al.  Perceiving, remembering, and communicating structure in events. , 2001, Journal of experimental psychology. General.

[15]  Scott W. Brown Time, change, and motion: The effects of stimulus movement on temporal perception , 1995, Perception & psychophysics.

[16]  C. Burt,et al.  Retrospective duration estimation of public events , 1991, Memory & cognition.

[17]  R. Aslin,et al.  Statistical learning of higher-order temporal structure from visual shape sequences. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[18]  Dan Zakay,et al.  Relative and absolute duration judgments under prospective and retrospective paradigms , 1993 .

[19]  M G Boltz Effects of event structure on retrospective duration judgments , 1995, Perception & psychophysics.

[20]  R. Aslin,et al.  Encoding multielement scenes: statistical learning of visual feature hierarchies. , 2005, Journal of experimental psychology. General.

[21]  R. Gómez,et al.  Infant artificial language learning and language acquisition , 2000, Trends in Cognitive Sciences.

[22]  Douglas Poynter,et al.  Chapter 8 Judging the Duration of Time Intervals: A Process of Remembering Segments of Experience , 1989 .

[23]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[24]  K. Ryan,et al.  Mixed function oxidase reactions in biological oxidations: human placenta. , 1967, Science.

[25]  A. Yonelinas Components of episodic memory: the contribution of recollection and familiarity. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  Jeffrey M. Zacks,et al.  Using movement and intentions to understand simple events , 2004, Cogn. Sci..

[27]  R. Ornstein,et al.  The experience of time , 1986 .

[28]  Lili Sahakyan,et al.  A role for memory in prospective timing informs timing in prospective memory. , 2013, Journal of experimental psychology. General.

[29]  A. W. Melton Repetition and retrieval from memory. , 1967, Science.

[30]  M. Boltz,et al.  Duration judgments of naturalistic events in the auditory and visual modalities , 2005, Perception & psychophysics.

[31]  W. Poynter,et al.  Duration judgment and the segmentation of experience , 1983, Memory & cognition.

[32]  M Boltz,et al.  Temporal accent structure and the remembering of filmed narratives. , 1992, Journal of experimental psychology. Human perception and performance.

[33]  W Hirst,et al.  On the representation of events: a study of orientation, recall, and recognition. , 1989, Journal of experimental psychology. General.

[34]  Jeffrey M. Zacks,et al.  Event boundaries in perception affect memory encoding and updating. , 2009, Journal of experimental psychology. General.

[35]  Timothy F. Brady,et al.  Compression in visual working memory: using statistical regularities to form more efficient memory representations. , 2009, Journal of experimental psychology. General.

[36]  R. Ratcliff Methods for dealing with reaction time outliers. , 1993, Psychological bulletin.

[37]  A. Yonelinas The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[38]  V. Sloutsky The role of similarity in the development of categorization , 2003, Trends in Cognitive Sciences.

[39]  Brandon M. Liverence,et al.  Discrete events as units of perceived time. , 2012, Journal of experimental psychology. Human perception and performance.

[40]  Jeffrey M. Zacks,et al.  Segmentation in reading and film comprehension. , 2009, Journal of experimental psychology. General.

[41]  S. Grondin Timing and time perception: A review of recent behavioral and neuroscience findings and theoretical directions , 2010, Attention, perception & psychophysics.

[42]  Silvia P. Gennari,et al.  Time in language: Event duration in language comprehension , 2011, Cognitive Psychology.

[43]  Y Tsal,et al.  The role of segmentation in prospective and retrospective time estimation processes , 1994, Memory & cognition.

[44]  Jeffrey M. Zacks,et al.  Segmentation in the perception and memory of events , 2008, Trends in Cognitive Sciences.

[45]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[46]  Silvia P. Gennari,et al.  Representing time in language and memory: the role of similarity structure. , 2015, Acta psychologica.

[47]  Y. Kareev,et al.  The emergence of events , 1994, Cognition.