Contextual information access and storytelling in mixed reality using hypermedia

This article describes gaming and storytelling activities in a mixed environment that integrates the real and virtual worlds, uses an augmented reality paradigm, and is supported by a structuring and presentation framework for use in context-aware mixed-reality applications. The basis of the framework is a generic hypermedia model that can handle different media elements, objects, and relations between spaces and locations in physical and virtual worlds. A main component of the model deals with providing contextual content according to the state of the application and the person using it. A storytelling layer was also defined, mainly by using the contextual mechanisms of the base model. This layer provides abstractions to storytelling applications that reflect the morphology of common story structures and supports gaming flow. The framework is being tested in a gaming and storytelling environment that integrates the real world, media elements, and virtual 3D worlds.

[1]  Kevin M. Brooks.  Do story agents use rocking chairs? The theory and implementation of one model for computational narrative , 1997, MULTIMEDIA '96.

[2]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[3]  BushnellNolan.  Relationships between fun and the computer business , 1996 .

[4]  Nuno Correia,et al.  A mixed reality mystery game , 2003, ICEC.

[5]  Alessandro De Gloria,et al.  IEEE Pervasive Computing: Integrated Environments - User Testing a Hypermedia Tour Guide , 2002, IEEE Distributed Syst. Online.

[6]  Staffan Björk,et al.  Pirates! Using the Physical World as a Game Board , 2001, INTERACT.

[7]  David Crowe,et al.  M-Studio: an authoring application for context-aware multimedia , 2002, MULTIMEDIA '02.

[8]  Hideyuki Tamura,et al.  Mixed Reality: Future Dreams Seen at the Border between Real and Virtual Worlds , 2001, IEEE Computer Graphics and Applications.

[9]  Samir R. Das,et al.  Proceedings of the 24th Annual International Conference on Mobile Computing and Networking , 2000, MobiCom 2004.

[10]  Michael Gervautz,et al.  Collaborative gaming in augmented reality , 1998, VRST '98.

[11]  Alessandro De Gloria,et al.  User Testing a Hypermedia Tour Guide , 2002, IEEE Pervasive Comput..

[12]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[13]  Nuno Correia,et al.  Augmenting reality with geo-referenced information for environmental management , 2002, GIS '02.

[14]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[15]  Ian E. Smith,et al.  HyperCafe: narrative and aesthetic properties of hypervideo , 1996, HYPERTEXT '96.

[16]  Keith Cheverst,et al.  The role of adaptive hypermedia in a context-aware tourist GUIDE , 2002, CACM.

[17]  Edward Branigan.  Narrative Comprehension and Film , 1992 .

[18]  Dick C. A. Bulterman,et al.  The Amsterdam hypermedia model: adding time and context to the Dexter model , 1994, CACM.

[19]  Mayer D. Schwartz,et al.  The Dexter Hypertext Reference Model , 1994, CACM.

[20]  Hongjing Wu,et al.  AHAM: a Dexter-based reference model for adaptive hypermedia , 1999, Hypertext.

[21]  Joseph M. Goodman,et al.  HAM: a general-purpose hypertext abstract machine , 1987, Hypertext.

[22]  Volker Coors,et al.  Meeting the spirit of history , 2001, VAST '01.

[23]  Gregory D. Abowd,et al.  Rapid prototyping of mobile context-aware applications: the Cyberguide case study , 1996, MobiCom '96.

[24]  Vladimir Propp,et al.  Morphology of the folktale , 1959 .

[25]  Andrew Stern,et al.  Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade , 2003 .

[26]  Nuno Correia,et al.  HyperReal: a hypermedia model for mixed reality , 2003, HYPERTEXT '03.

[27]  Peter Ørbæk,et al.  Towards geo-spatial hypermedia: Concepts and prototype implementation , 2002, HYPERTEXT '02.

[28]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[29]  Wayne Piekarski,et al.  ARQuake: the outdoor augmented reality gaming system , 2002, CACM.

[30]  Bastian Leibe,et al.  MIND-WARPING: towards creating a compelling collaborative augmented reality game , 2000, IUI '00.

[31]  Ian MacColl,et al.  The Use of Spatial Models in Mixed-Reality Systems , 2002 .

[32]  Norman K. Meyrowitz.  Intermedia: The Architecture and Construction of an Object-Oriented Hypermedia System and Applications Framework , 1986, OOPSLA.

[33]  Reiner Wichert.  Collaborative Gaming in a Mobile Augmented Reality Environment , 2002 .

[34]  Norman Meyrowitz,et al.  Intermedia: The architecture and construction of an object-oriented hypemedia system and applications framework , 1986, OOPLSA '86.

[35]  Randall H. Trigg,et al.  Design issues for a Dexter-based hypermedia system , 1992, ECHT '92.

[36]  Jonathan Munson,et al.  An approach to providing a seamless end-user experience for location-aware applications , 2001, WMC '01.

[37]  Randall H. Trigg,et al.  Notecards in a nutshell , 1986, CHI '87.

[38]  Wolfgang Wahlster,et al.  A resource-adaptive mobile navigation system , 2002, IUI '02.

[39]  Mayer D. Schwartz,et al.  Contexts: a partitioning concept for hypertext , 1986, CSCW '86.