Crowdsourcing Narrative Intelligence

Narrative intelligence is an important part of human cognition, especially in sensemaking and communicating with people. Humans draw on a lifetime of relevant experiences to explain stories, to tell stories, and to help choose the most appropriate actions in real-life settings. Manual authoring the required knowledge presents a significant bottleneck in the creation of systems demonstrating narrative intelligence. In this paper, we describe a novel technique for automatically learning script-like narrative knowledge from crowdsourcing. By leveraging human workers’ collective understanding of social and procedural constructs, we can learn a potentially unlimited range of scripts regarding how real-world situations unfold. We present quantitative evaluations of the learned primitive events and the temporal ordering of events, which suggest we can identify orderings between events with high accuracy.

[1]  R. Barthes,et al.  An Introduction to the Structural Analysis of Narrative , 1975 .

[2]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[3]  R. Abelson.  Psychological status of the script concept. , 1981 .

[4]  R. Schank,et al.  Inside Computer Understanding: Five Programs Plus Miniatures , 1982 .

[5]  J. Fodor.  The Modularity of mind. An essay on faculty psychology , 1986 .

[6]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[7]  R. Glaser.  Education and Thinking: The Role of Knowledge. , 1984 .

[8]  T. Trabasso,et al.  Causal relatedness and importance of story events , 1985 .

[9]  J. Bruner.  The Narrative Construction of Reality , 1991, Critical Inquiry.

[10]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[11]  Richard J. Gerrig,et al.  Experiencing Narrative Worlds: On the Psychological Activities of Reading , 1993 .

[12]  T. Trabasso,et al.  Constructing inferences during narrative text comprehension. , 1994, Psychological review.

[13]  Philip Resnik,et al.  Using Information Content to Evaluate Semantic Similarity in a Taxonomy , 1995, IJCAI.

[14]  Lynette Hirschman,et al.  A Model-Theoretic Coreference Scoring Scheme , 1995, MUC.

[15]  M. Mateas,et al.  What is Narrative Intelligence ? , 1998 .

[16]  M. Ankerst,et al.  OPTICS: ordering points to identify the clustering structure , 1999, ACM SIGMOD Conference.

[17]  Phoebe Sengers,et al.  Narrative intelligence : papers from the 1999 AAAI Fall Symposium, November 5-7, North Falmouth, Massachusetts , 1999 .

[18]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[19]  David S. Miall.  Experiencing narrative worlds: On the psychological activities of reading , 2000 .

[20]  R. Sternberg,et al.  Tacit Knowledge and Practical Intelligence: Understanding the Lessons of Experience , 2002 .

[21]  Push Singh,et al.  LifeNet: A Propositional Model of Ordinary Human Activity , 2003 .

[22]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[23]  Roxana Gîrju,et al.  Automatic Detection of Causal Relations for Question Answering , 2003, ACL 2003.

[24]  J. Singer,et al.  Narrative identity and meaning making across the adult lifespan: an introduction. , 2004, Journal of personality.

[25]  Erik T. Mueller,et al.  Modelling Space and Time in Narratives about Restaurants , 2007, Lit. Linguistic Comput..

[26]  Nathanael Chambers,et al.  Unsupervised Learning of Narrative Event Chains , 2008, ACL.

[27]  Judith R. Johnston,et al.  Narratives: Twenty‐Five Years Later , 2008 .

[28]  Reid Swanson,et al.  Say Anything: A Massively Collaborative Open Domain Story Writing Companion , 2008, ICIDS.

[29]  Vasile Rus,et al.  Paraphrase Identification Using Weighted Dependencies and Word Semantics , 2010, Informatica.

[30]  Pablo Gervás,et al.  Computational Approaches to Storytelling and Creativity , 2009, AI Mag..

[31]  Jeff Orkin,et al.  Automatic learning and generation of social behavior from collective human gameplay , 2009, AAMAS.

[32]  Tim Oates,et al.  Mining Script-Like Structures from the Web , 2010, HLT-NAACL 2010.

[33]  Michael Mateas,et al.  Comme il Faut 2: a fully realized model for socially-oriented gameplay , 2010, FDG.

[34]  J. Pearl.  3. The Foundations of Causal Inference , 2010 .

[35]  Sung-Hyon Myaeng,et al.  Automatic construction of a large-scale situation ontology by mining how-to instructions from the web , 2010, J. Web Semant..

[36]  Keith Oatley,et al.  Emotion and narrative fiction: Interactive influences before, during, and after reading , 2011, Cognition & emotion.

[37]  Cosmin Adrian Bejan,et al.  Commonsense Causal Reasoning Using Millions of Personal Stories , 2011, AAAI.

[38]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[39]  Nathan Schneider,et al.  Association for Computational Linguistics: Human Language Technologies , 2011 .

[40]  Jane Yung-jen Hsu,et al.  Contextual Commonsense Knowledge Acquisition from Social Content by Crowd-Sourcing Explanations , 2012, HCOMP@AAAI.

[41]  Gregory D. Abowd,et al.  Socially computed scripts to support social problem solving skills , 2012, CHI.