Evaluating the Pairwise Event Salience Hypothesis in Indexter

Indexter is a plan-based computational model of narrative discourse which leverages cognitive scientific theories of how events are stored in memory during online comprehension. These discourse models are valuable for static and interactive narrative generation systems because they allow the author to reason about the audience’s understanding and attention as they experience a story. A pair of Indexter events can share up to five indices: protagonist, time, space, causality, and intentionality. We present the first in a planned series of evaluations that will explore increasingly nuanced method of using these indices to predict salience. The Pairwise Event Salience Hypothesis states that when a past event shares one or more indices with the most recently narrated event, that past event is more salient than one which shares no indices with the most recently narrated event. A crowd-sourced (n = 200) study of 24 short text stories that control for content, text, and length supports this hypothesis. While this is encouraging, we believe it also motivates the development of a richer model that accounts for intervening events, narrative complexity, and episodic memory decay.

[1]  Jeffrey M. Zacks,et al.  Perceiving, remembering, and communicating structure in events. , 2001, Journal of experimental psychology. General.

[2]  Robert Michael Young,et al.  Cinematic Visual Discourse: Representation, Generation, and Evaluation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[3]  Jeffrey M. Zacks,et al.  Segmentation in reading and film comprehension. , 2009, Journal of experimental psychology. General.

[4]  S. Greenspan,et al.  Updating situation models during narrative comprehension , 1989 .

[5]  Robert Michael Young,et al.  Good Timing for Computational Models of Narrative Discourse , 2015, CMN.

[6]  L. Jacoby,et al.  Dissociations of processes in recognition memory: effects of interference and of response speed. , 1994, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[7]  Michael Young.  Planning in Narrative Generation : A Review of Plan-Based Approaches to the Generation of Story , Discourse and Interactivity in Narratives , 2015 .

[8]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[9]  T. Trabasso,et al.  Causal relatedness and importance of story events , 1985 .

[10]  William F. Brewer,et al.  Use of plan schemata in the recall and recognition of goal-directed actions. , 1983 .

[11]  Neil Stewart,et al.  Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments , 2014, Behavior research methods.

[12]  Robert Michael Young,et al.  Narrative Generation for Suspense: Modeling and Evaluation , 2008, ICIDS.

[13]  Stephen G. Ware,et al.  Foreseeing Meaningful Choices , 2014, AIIDE.

[14]  Rolf A. Zwaan,et al.  Indexing space and time in film understanding , 2001 .

[15]  Robert Michael Young,et al.  A Computational Model of Narrative Generation for Surprise Arousal , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[16]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[17]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[18]  Robert Michael Young,et al.  Narrative Planning: Balancing Plot and Character , 2010, J. Artif. Intell. Res..

[19]  T. Trabasso,et al.  Causal thinking and the representation of narrative events , 1985 .

[20]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[21]  M. Bal,et al.  Narratology: Introduction to the Theory of Narrative , 1988 .

[22]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[23]  Stephen G. Ware,et al.  Indexter : A Computational Model of the Event-Indexing Situation Model for Characterizing Narratives , 2012 .