A semiotic approach for the generation of themed photo narratives

A wide variety of systems could be considered 'narrative systems', either directly working towards generating rich narratives or, more frequently, because they present or handle information in a narrative context. These narratives, generated or otherwise handled, may contain themes; an essential part of the subtext of narrative communicating important concepts outside the capabilities of the literal meaning of the content and forming the thematic cohesion that aids the flow of the presented narrative. However despite this very little work has been undertaken to understand of take advantage of these themes, particularly in narrative generation where the presence of well defined themes may improve the richness of those generated narratives. In this paper we evaluate the performance of a system utilising a thematic model in order to generate simple narratives in the form of photo montages compared to a keyword based system that does not. The experiment demonstrates that the system utilising the thematic model is capable of successfully connoting themes within these narratives. It also shows that the relevance of the resulting narratives to the titles used to generate them is higher in the thematic system than those generated by the other system.

[1]  Peter Brusilovsky,et al.  Adaptive hypermedia: from systems to framework , 1999, CSUR.

[2]  Ellen M. Voorhees,et al.  Query expansion using lexical-semantic relations , 1994, SIGIR '94.

[3]  M. Mcquillan.  The Narrative Reader , 2000 .

[4]  M. Bal,et al.  Narratology: Introduction to the Theory of Narrative , 1988 .

[5]  Dirk Heylen,et al.  The Virtual Storyteller: story creation by intelligent agents , 2003 .

[6]  F. Saussure,et al.  Course in General Linguistics , 1960 .

[7]  Marc Cavazza,et al.  Agents' Interaction in Virtual Storytelling , 2001, IVA.

[8]  Ferdinand de Saussure.  Course in General Linguistics , 1916 .

[9]  Thomas S. Huang,et al.  Unifying Keywords and Visual Contents in Image Retrieval , 2002, IEEE Multim..

[10]  James Allan,et al.  Automatic Query Expansion Using SMART: TREC 3 , 1994, TREC.

[11]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[12]  Robert Michael Young,et al.  Character-Focused Narrative Generation for Execution in Virtual Worlds , 2003, International Conference on Virtual Storytelling.

[13]  James R. Meehan,et al.  TALE-SPIN, An Interactive Program that Writes Stories , 1977, IJCAI.

[14]  Lloyd Rutledge,et al.  Sequence and Emphasis in Automated Domain-Independent Discourse Generation , 2003 .

[15]  Paolo Rosso,et al.  A WordNet-based Query Expansion Method for Geographical Information Retrieval , 2005, CLEF.

[16]  Nigel Shadbolt,et al.  Image annotation with Photocopain , 2006 .

[17]  Peter Willett,et al.  The limitations of term co-occurrence data for query expansion in document retrieval systems , 1991, J. Am. Soc. Inf. Sci..

[18]  Lee T. Lemon,et al.  Russian formalist criticism : four essays , 1968 .

[19]  R. Barthes,et al.  An Introduction to the Structural Analysis of Narrative , 1975 .

[20]  David E. Millard,et al.  Using a thematic model to enrich photo montages , 2009, HT '09.

[21]  Natalia Stash,et al.  AHA! The adaptive hypermedia architecture , 2003, HYPERTEXT '03.

[22]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[23]  Licia Calvi.  “Lector in rebus”: the role of the reader and the characteristics of hyperreading , 1999, HYPERTEXT '99.

[24]  David E. Millard,et al.  Ontologies as facilitators for repurposing web documents , 2007, Int. J. Hum. Comput. Stud..

[25]  David E. Millard,et al.  Investigating a thematic approach to narrative generation , 2009 .

[26]  W. Bruce Croft,et al.  Query expansion using local and global document analysis , 1996, SIGIR '96.

[27]  W. Riggan,et al.  The Rhetoric of Fiction , 1984 .

[28]  M. Weal,et al.  A thematic approach to emerging narrative structure , 2008, WebScience '08.

[29]  Takenobu Tokunaga,et al.  Combining multiple evidence from different types of thesaurus for query expansion , 1999, SIGIR '99.