Capturing experience: a matter of contextualising events

This paper explores the notion of experience in the context of dynamic and interactive environments, such as web-based musea, where neither the individual user requirements nor the requested material can be predicted in advance. A definition of experiences for the particular context is introduced on which the analysis of the what (events), why (context) and the how (presentation) are based. The paper tries to identify the essential aspects of representation for the three main fields of investigation, namely content and expression for the event; goal, task action and role for the context, and the influence of event and context for the presentation. The aim is that the system can find satisfactory solutions for upcoming questions (e.g. based on the content of an image), misunderstandings (rearrangement of the material) or non-understanding (creation of a new sequence). The intent of the paper is to provide a first step towards dynamic and adaptive knowledge structures that facilitate conceptual presentations.

[1]  Ramesh C. Jain.  Experiential computing , 2003, CACM.

[2]  Glorianna Davenport,et al.  The Stratification System - A Design Emvironment for Random Access , 1992, NOSSDAV.

[3]  Lynda Hardman,et al.  Towards Ontology-Driven Discourse: From Semantic Graphs to Multimedia Presentations , 2003, SEMWEB.

[4]  S. Chatman,et al.  Story and Discourse: Narrative Structure in Fiction and Film , 1979 .

[5]  Lynda Hardman,et al.  Denotative and connotative semantics in hypermedia: proposal for a semiotic-aware architecture , 2001, New Rev. Hypermedia Multim..

[6]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[7]  Marc Davis,et al.  Media streams: representing video for retrieval and repurposing , 1994, MULTIMEDIA '94.

[8]  Alan P. Parkes,et al.  The Application of Video Semantics and Theme Representation in Automated Video Editing , 2004, Multimedia Tools and Applications.

[9]  Shih-Fu Chang,et al.  A utility framework for the automatic generation of audio-visual skims , 2002, MULTIMEDIA '02.

[10]  Kevin M. Brooks,et al.  Metalinear cinematic narrative : theory, process, and tool , 1999 .

[11]  Lynda Hardman,et al.  Colour Picking-the Pecking Order of Form and Function , 2003 .

[12]  Alan P. Parkes.  An artificial intelligence approach to the conceptual description of videodisc images , 1988 .

[13]  Keiji Hirata.  Towards Formalizing Jazz Piano Knowledge with a Deductive Object-Oriented Approach , 1995 .

[14]  Glorianna Davenport,et al.  The Stratification System A Design Environment for Random Access Video , 2005 .

[15]  Douglas Keislar,et al.  Content-Based Classification, Search, and Retrieval of Audio , 1996, IEEE Multim..

[16]  Craig A. Lindley.  A Video Annoation Methodology for Interactive Video Sequence Generation , 2001, Digital Content Creation.

[17]  Lloyd Rutledge,et al.  Towards second and third generation web-based multimedia , 2001, WWW '01.

[18]  Yukinobu Taniguchi,et al.  Structured Video Computing , 1994, IEEE MultiMedia.

[19]  Andrew Rosenbloom,et al.  Introduction , 2003, CACM.

[20]  Judy Robertson,et al.  Real-time music generation for a virtual environment , 1998 .

[21]  William R. Swartout,et al.  Making a game of system design , 2003, CACM.

[22]  Nicola Orio,et al.  SMILE: a System for Content-based Musical Information Retrieval Environments , 2000, RIAO.

[23]  Menzo Windhouwer,et al.  The Role of High-Level and Low-Level Features in Semi-Automated Retrieval and Generation of Multimed , 1988 .

[24]  S. Chatman.  Story and Discourse: Narrative Structure in Fiction and Film , 1980 .

[25]  Glorianna Davenport,et al.  ConText towards the evolving documentary , 1995, MULTIMEDIA '95.

[26]  Brian P. Bailey,et al.  DEMAIS: designing multimedia applications with interactive storyboards , 2001, MULTIMEDIA '01.