Imagined versus Remembered Stories: Quantifying Differences in Narrative Flow

Lifelong experiences and learned knowledge lead to shared expectations about how common situations tend to unfold. Such knowledge of narrative event flow enables people to weave together a story. However, comparable computational tools to evaluate the flow of events in narratives are limited. We quantify the differences between autobiographical and imagined stories by introducing sequentiality , a measure of narrative flow of events, drawing probabilistic inferences from a cutting-edge large language model (GPT-3). Sequentiality captures the flow of a narrative by comparing the probability of a sentence with and without its preceding story context. We applied our measure to study thousands of diary-like stories, collected from crowdworkers about either a recent remembered experience or an imagined story on the same topic. The results show that imagined stories have higher sequentiality than autobiographical stories and that the sequentiality of autobiographical stories increases when the memories are retold several months later. In pur-suit of deeper understandings of how sequentiality measures the flow of narratives, we explore proportions of major and minor events in story sentences, as annotated by crowdworkers. We find that lower sequentiality is associated with higher proportions of major events. The methods and results highlight opportunities to use cutting-edge computational analyses, such as sequentiality, on large corpora of matched imagined and autobiographical stories to investigate the influences of memory and reasoning on language generation processes.

[1]  Michael S. Bernstein,et al.  On the Opportunities and Risks of Foundation Models , 2021, ArXiv.

[2]  Philippe Laban,et al.  Can Transformer Models Measure Coherence In Text: Re-Thinking the Shuffle Test , 2021, ACL.

[3]  Tal August,et al.  All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text , 2021, ACL.

[4]  Olivier Toubia,et al.  How quantifying the shape of stories predicts their success , 2021, Proceedings of the National Academy of Sciences.

[5]  Samuel A. Nastase,et al.  Thinking ahead: spontaneous prediction in context as a keystone of language in humans and machines , 2020, bioRxiv.

[6]  Kate G. Blackburn,et al.  The narrative arc: Revealing core narrative structures through text analysis , 2020, Science Advances.

[7]  Eric Horvitz,et al.  Recollection versus Imagination: Exploring Human Memory and Cognition via Neural Language Models , 2020, ACL.

[8]  Mark Chen,et al.  Language Models are Few-Shot Learners , 2020, NeurIPS.

[9]  Péter Simor,et al.  Novelty Manipulations, Memory Performance, and Predictive Coding: the Role of Unexpectedness , 2020, Frontiers in Human Neuroscience.

[10]  T. Underwood Machine Learning and Human Perspective , 2020, PMLA/Publications of the Modern Language Association of America.

[11]  Margaret L. Kern,et al.  Estimating geographic subjective well-being from Twitter: A comparison of dictionary and data-driven language methods , 2019, Proceedings of the National Academy of Sciences.

[12]  David Bamman,et al.  Literary Event Detection , 2019, ACL.

[13]  Robert T. Knight,et al.  Medial Orbitofrontal Cortex, Dorsolateral Prefrontal Cortex, and Hippocampus Differentially Represent the Event Saliency , 2019, Journal of Cognitive Neuroscience.

[14]  Robert T. Knight,et al.  Event segmentation reveals working memory forgetting rate , 2019, bioRxiv.

[15]  L. Davachi,et al.  Transcending time in the brain: How event memories are constructed from experience , 2019, Hippocampus.

[16]  Samuel J. Gershman,et al.  Structured event memory: a neuro-symbolic model of event cognition , 2019, bioRxiv.

[17]  Jennifer Edson Escalas,et al.  What Happens in Vegas Stays on TripAdvisor? A Theory and Technique to Understand Narrativity in Consumer Reviews , 2018, Journal of Consumer Research.

[18]  A. Mendelsohn,et al.  Autobiographical memory: From experiences to brain representations , 2017, Neuropsychologia.

[19]  Christopher M. Danforth,et al.  The emotional arcs of stories are dominated by six basic shapes , 2016, EPJ Data Science.

[20]  C. Fioretti,et al.  Why Narrating Changes Memory: A Contribution to an Integrative Model of Memory and Narrative Processes , 2016, Integrative psychological & behavioral science.

[21]  Robin L. Nabi,et al.  The Role of a Narrative's Emotional Flow in Promoting Persuasive Outcomes , 2015 .

[22]  Amy Beth Warriner,et al.  Concreteness ratings for 40 thousand generally known English word lemmas , 2014, Behavior research methods.

[23]  Benjamin Van Durme,et al.  Reporting bias and knowledge acquisition , 2013, AKBC '13.

[24]  Boyang Li,et al.  Story Generation with Crowdsourced Plot Graphs , 2013, AAAI.

[25]  R. Henson,et al.  How schema and novelty augment memory formation , 2012, Trends in Neurosciences.

[26]  J. Hudson,et al.  The self in autobiographical memory: Effects of self-salience on narrative content and structure , 2011, Memory.

[27]  J. Pennebaker,et al.  The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods , 2010 .

[28]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[29]  Jeffrey M. Zacks,et al.  Segmentation in the perception and memory of events , 2008, Trends in Cognitive Sciences.

[30]  D. Schacter,et al.  The cognitive neuroscience of constructive memory: remembering the past and imagining the future , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  Jeffrey M. Zacks,et al.  Event perception: a mind-brain perspective. , 2007, Psychological bulletin.

[32]  Elizabeth J. Marsh,et al.  Retelling Is Not the Same as Recalling , 2007 .

[33]  Sharron E. Whitecross,et al.  Neurophysiological correlates of memory for experienced and imagined events , 2003, Neuropsychologia.

[34]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[35]  E. Loftus,et al.  Errors in autobiographical memory. , 1998, Clinical psychology review.

[36]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[37]  A. Stone,et al.  Emotional expression and physical health: revising traumatic memories or fostering self-regulation? , 1996, Journal of personality and social psychology.

[38]  Stephen J. Anderson,et al.  Recollections of true and false autobiographical memories. , 1996 .

[39]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[40]  John B. Black,et al.  Causal coherence and memory for events in narratives , 1981 .

[41]  L R Squire,et al.  Two forms of human amnesia: an analysis of forgetting , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  Arthur C. Graesser,et al.  Incorporating inferences in narrative representations: A study of how and why , 1981, Cognitive Psychology.

[43]  John B. Black,et al.  Scripts in memory for text , 1979, Cognitive Psychology.

[44]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[45]  P. Thorndyke Cognitive structures in comprehension and memory of narrative discourse , 1977, Cognitive Psychology.

[46]  F. Bartlett,et al.  Remembering: A Study in Experimental and Social Psychology , 1932 .

[47]  David Bamman,et al.  Narrative Theory for Computational Narrative Understanding , 2021, EMNLP.

[48]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[49]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[50]  K. Michaelian Episodic and semantic memory and imagination: The need for definitions , 2018 .

[51]  Alec Radford,et al.  Improving Language Understanding by Generative Pre-Training , 2018 .

[52]  W. Kintsch,et al.  The role of culture‐specific schemata in the comprehension and recall of stories∗ , 1978 .

[53]  E. Tulving,et al.  Episodic and semantic memory , 1972 .