Theory and technology for computational narrative: an approach to generative and interactive narrative with bases in algebraic semiotics and cognitive linguistics

This dissertation presents theoretical and technical support for, and implementations of, narrative computational media works with the following characteristics: generative content, semantics-based interaction, reconfigurable narrative structure, and strong cognitive and socio-cultural grounding. A system that can dynamically compose media elements (such as procedural computer graphics, digital video, or text) to result in new media elements can be said to generate content. The GRIOT system, a result of this dissertation, provides an example of this. It has been used to implement computational poetry that generates new narrative poems with varying particular concepts, but fixed themes, upon each execution. This generativity is enabled by the Alloy system, which implements an algorithm that models key aspects of Gilles Fauconnier and Mark Turner's theory of conceptual blending. Alloy is the first implementation of Joseph Goguen's algebraic semiotics approach to blending (Fauconnier & Turner, 2002; Goguen, 1998). This research also contributes to the theory of algebraic semiotics by developing a blending-based notion of style. Semantics-based interaction means here that (1) media elements are structured according to the meaning of their content, and (2) user interaction can affect content of a computational narrative in a way that produces new meanings that are constrained by the system's author. "Meaning" in this case indicates that the author has provided formal descriptions of domains and concepts pertinent to the media elements and subjective authorial intent. Meaning can also be reconfigured at the level of narrative discourse. The formal structure of a computational narrative can be dynamically restructured, either according to user interaction, or upon execution of the system as in the case of narrative generation. Strong cognitive and socio-cultural grounding here implies that meaning is considered to be contextual, dynamic, and embodied. The formalizations used derive from, and respect, cognitive linguistics theories with such notions of meaning. Furthermore, the notion of narrative here is not biased toward one particular cultural model. Using semantically based media elements as a foundation, a cultural producer can implement a range of culturally specific or experimental narrative structures.

[1]  C. Hartshorne,et al.  Collected Papers of Charles Sanders Peirce , 1935, Nature.

[2]  Rashomon, and other stories , 1952 .

[3]  F. Saussure,et al.  Course in General Linguistics , 1960 .

[4]  R. Queneau Cent Mille Milliards de poèmes , 1961 .

[5]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[6]  B. Sutton-Smith,et al.  The Study of Games , 1971 .

[7]  G. Bateson Steps to an Ecology of Mind , 1972 .

[8]  Leonard Talmy,et al.  Figure and Ground in Complex Sentences , 1975 .

[9]  James R. Meehan,et al.  The Metanovel: Writing Stories by Computer , 1976, Outstanding Dissertations in the Computer Sciences.

[10]  G. Nunberg The pragmatics of reference , 1978 .

[11]  Maximillian Jahn Narratology: A guide to the theory of Narrative , 1981 .

[12]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[13]  N. Cocchiarella,et al.  Situations and Attitudes. , 1986 .

[14]  R. Langacker Foundations of cognitive grammar , 1983 .

[15]  Dedre Gentner,et al.  Structure-Mapping: A Theoretical Framework for Analogy , 1983, Cogn. Sci..

[16]  Racter The Policeman's Beard Is Half Constructed , 1984 .

[17]  P. Anderson The Uses of Literature , 1984, The Uses of Literature.

[18]  Charles J. Fillmore,et al.  Frames and the semantics of understanding , 1985 .

[19]  Gilles Fauconnier,et al.  Mental Spaces: Aspects of Meaning Construction in Natural Language , 1985 .

[20]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[21]  Stuart M. Shieber,et al.  An Introduction to Unification-Based Approaches to Grammar , 1986, CSLI Lecture Notes.

[22]  P. Tichý Constructions , 1986, Philosophy of Science.

[23]  H. Gates,,et al.  The Signifying Monkey: A Theory of African-American Literary Criticism , 1988 .

[24]  M. Yazdani A computational model of creativity , 1988 .

[25]  G. Lakoff Women, fire, and dangerous things : what categories reveal about the mind , 1989 .

[26]  F. Nuessel More Than Cool Reason: A Field Guide to Poetic Metaphor , 1990 .

[27]  G. Lakoff The Invariance Hypothesis: is abstract reason based on image-schemas? , 1990 .

[28]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[29]  Joseph Bates,et al.  Virtual Reality, Art, and Entertainment , 1992, Presence: Teleoperators & Virtual Environments.

[30]  James Thomas,et al.  Flash fiction : very short stories , 1992 .

[31]  C. Linde Life Stories: The Creation of Coherence , 1993 .

[32]  A. D. Manning,et al.  Understanding Comics: The Invisible Art , 1993 .

[33]  Peter Szolovits,et al.  What Is a Knowledge Representation? , 1993, AI Mag..

[34]  L. Cutrer Time and tense in narrative and in everyday language , 1994 .

[35]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[36]  Wolfgang Klein,et al.  Frame of analysis , 1995 .

[37]  Scott K. Liddell,et al.  Spatial representations in discourse: Comparing spoken and signed language , 1996 .

[38]  J. Wideman The Cattle Killing , 1996 .

[39]  Joseph A. Goguen,et al.  Algebraic semantics of imperative programs , 1996, Foundations of computing series.

[40]  G. Fauconnier,et al.  Spaces, worlds, and grammar , 1996 .

[41]  W. S. Reilly,et al.  Believable Social and Emotional Agents. , 1996 .

[42]  Juan Montes de Oca Walking around , 1996, SIGGRAPH '96.

[43]  Charles O. Hartman Virtual Muse: Experiments In Computer Poetry , 1996 .

[44]  M. Turner The literary mind. , 1997 .

[45]  Espen Aarseth Cybertext: Perspectives on Ergodic Literature , 1997 .

[46]  Karen Van Hoek,et al.  Anaphora and Conceptual Structure , 1997 .

[47]  Nili Mandelblit,et al.  Grammatical Blending: Creative and Schematic Aspects in Sentence Processing and Translation , 1997 .

[48]  Joseph Bates,et al.  Guiding interactive drama , 1997 .

[49]  Barbara S. Page Hamlet on the Holodeck: The Future of Narrative in Cyberspace , 1999 .

[50]  G. Lakoff,et al.  Philosophy in the flesh : the embodied mind and its challenge to Western thought , 1999 .

[51]  Joseph A. Goguen Social and Semiotic Analyses for Theorem Prover User Interface Design 1 , 1999, Formal Aspects of Computing.

[52]  Selmer Bringsjord,et al.  Artificial Intelligence and Literary Creativity: Inside the Mind of Brutus, A Storytelling Machine , 1999 .

[53]  R. Gibbs,et al.  Blending and Metaphor , 1999 .

[54]  J. Goguen An introduction to algebraic semiotics, with application to user interface design , 1999 .

[55]  Michael Mateas,et al.  An Oz-Centric Review of Interactive Drama and Believable Agents , 1999, Artificial Intelligence Today.

[56]  Srinivas Narayanan,et al.  Moving Right Along: A Computational Model of Metaphoric Reasoning about Events , 1999, AAAI/IAAI.

[57]  Marc Davis,et al.  A Brief Overview of the Narrative Intelligence Reading Group , 2003 .

[58]  Seana Coulson,et al.  Semantic Leaps: FRAME-SHIFTING , 2001 .

[59]  Kenneth D. Forbus,et al.  Exploring analogy in the large , 2000 .

[60]  MorphismsJoseph A. GoguenDept Information Visualization and Semiotic Morphisms , 2000 .

[61]  G. Fauconnier Methods and Generalizations , 2001 .

[62]  Gibbs,et al.  Making good psychology out of blending theory. , 2001 .

[63]  J. Overhage,et al.  Sorting Things Out: Classification and Its Consequences , 2001, Annals of Internal Medicine.

[64]  T. Veale,et al.  Computation and Blending , 2001 .

[65]  D. Gentner,et al.  The analogical mind : perspectives from cognitive science , 2001 .

[66]  Brian F. Bowdle,et al.  Metaphor is like analogy , 2001 .

[67]  Jaime G. Carbonell,et al.  Interactive drama, art and artificial intelligence , 2002 .

[68]  G. Fauconnier,et al.  The Way We Think: Conceptual Blending and the Mind''s Hidden Complexities. Basic Books , 2002 .

[69]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[70]  G. Lakoff,et al.  Why cognitive linguistics requires embodied realism , 2002 .

[71]  M. Mateas,et al.  The Recombinant History Apparatus Presents : Terminal Time Steffi Domike , 2003 .

[72]  Mark Turner Double-Scope Stories , 2003 .

[73]  D. Lehman Great American prose poems : from Poe to the present , 2003 .

[74]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[75]  J. A. Goguen,et al.  The logic of inexact concepts , 1969, Synthese.

[76]  Mark Turner,et al.  The Origin of Selkies , 2004 .

[77]  Joseph A. Goguen,et al.  Style as a Choice of Blending Principles , 2004, AAAI Technical Report.

[78]  Johan F. Hoorn,et al.  Distributed cognition , 2005, Cognition, Technology & Work.

[79]  E. Hutchins Material anchors for conceptual blends , 2005 .

[80]  D. Gentner,et al.  Introduction : The Place of Analogy in Cognition , 2005 .

[81]  D. F. Harrell Algebra of Identity: Skin of Wind, Skin of Streams, Skin of Shadows, Skin of Vapor , 2005 .

[82]  D. Harrell Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation , 2005 .

[83]  D. Harrell Walking Blues Changes Undersea : Imaginative Narrative in Interactive Poetry Generation with the GRIOT System , 2006 .

[84]  R. Jakobson Closing Statement: Linguistics and Poetics , 2006 .

[85]  M. Horvat,et al.  Conflict Engine: Privileging Drama in Drama Management , 2007 .

[86]  B. Bergen,et al.  The cognitive linguistics enterprise: an overview , 2007 .

[87]  G. Fauconnier,et al.  Rethinking Metaphor , 2008 .

[88]  Kenny K. N. Chow,et al.  Active Animation : An Approach to Interactive and Generative Animation for User-Interface Design and Expression , 2009 .

[89]  Leah M. Mickens,et al.  Rescuing the legacy project: a case study in digital preservation and technical obsolescence , 2009 .

[90]  Ray Vichot "Doing it for the lulz"?: online communities of practice and offline tactical media , 2009 .