HyperReal: a hypermedia model for mixed reality

This paper describes a generic hypermedia model that is used as a framework for building context aware and mixed reality applications. It can handle different media elements, and it defines a presentation scheme that abstracts several relevant navigation concepts, including link awareness. The model specifies a base structure for the relation between spaces, either real or virtual, and supports contextual mechanisms. Additionally, it establishes a way to correlate real/virtual world objects with information present in the hypermedia graph. It also includes store/replay mechanisms that can be used to repurpose the content in new ways, including storytelling applications. The proposed model is being tested in a gaming and storytelling environment that integrates the real world, media elements and virtual 3D worlds. The paper presents the overall framework, the current implementation and evaluates its usage in the prototype application.

[1]  Jonathan Munson,et al.  An approach to providing a seamless end-user experience for location-aware applications , 2001, WMC '01.

[2]  Steve Benford,et al.  Where on-line meets on the streets: experiences with mobile mixed reality games , 2003, CHI '03.

[3]  Dick C. A. Bulterman,et al.  The Amsterdam hypermedia model: adding time and context to the Dexter model , 1994, CACM.

[4]  Norman K. Meyrowitz.  Intermedia: The Architecture and Construction of an Object-Oriented Hypermedia System and Applications Framework , 1986, OOPSLA.

[5]  Lloyd Rutledge,et al.  Hypermedia: the link with time , 1999, CSUR.

[6]  Nolan Bushnell.  Relationships between fun and the computer business , 1996, CACM.

[7]  Keith Cheverst,et al.  The role of adaptive hypermedia in a context-aware tourist GUIDE , 2002, CACM.

[8]  Wolfgang Wahlster,et al.  A resource-adaptive mobile navigation system , 2002, IUI '02.

[9]  Peter Brusilovsky,et al.  Methods and techniques of adaptive hypermedia , 1996, User Modeling and User-Adapted Interaction.

[10]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[11]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[12]  Ian E. Smith,et al.  HyperCafe: narrative and aesthetic properties of hypervideo , 1996, HYPERTEXT '96.

[13]  Ian MacColl,et al.  The Use of Spatial Models in Mixed-Reality Systems , 2002 .

[14]  Geert-Jan Houben,et al.  An extensible data model for hyperdocuments , 1992, ECHT '92.

[15]  Hongjing Wu,et al.  AHAM: a Dexter-based reference model for adaptive hypermedia , 1999, Hypertext.

[16]  Alessandro De Gloria,et al.  User Testing a Hypermedia Tour Guide , 2002, IEEE Pervasive Comput..

[17]  Alessandro De Gloria,et al.  IEEE Pervasive Computing: Integrated Environments - User Testing a Hypermedia Tour Guide , 2002, IEEE Distributed Syst. Online.

[18]  Gustavo Rossi,et al.  The object-oriented hypermedia design model , 1995, CACM.

[19]  Teresa Chambel,et al.  Context perception in video-based hypermedia spaces , 2002, HYPERTEXT '02.

[20]  Randall H. Trigg,et al.  Notecards in a nutshell , 1986, CHI '87.

[21]  Peter Ørbæk,et al.  Towards geo-spatial hypermedia: Concepts and prototype implementation , 2002, HYPERTEXT '02.

[22]  Joseph M. Goodman,et al.  HAM: a general-purpose hypertext abstract machine , 1987, Hypertext.

[23]  Randall H. Trigg,et al.  Design issues for a Dexter-based hypermedia system , 1992, ECHT '92.

[24]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[25]  Mayer D. Schwartz,et al.  The Dexter Hypertext Reference Model , 1994, CACM.

[26]  Carlo Strapparava,et al.  Hypernavigation in the physical space: adapting presentations to the user and to the situational context (Technical Note) , 1998, New Rev. Hypermedia Multim..

[27]  Bruce H. Thomas,et al.  First Person Indoor/Outdoor Augmented Reality Application: ARQuake , 2002, Personal and Ubiquitous Computing.

[28]  Gregory D. Abowd,et al.  Rapid prototyping of mobile context-aware applications: the Cyberguide case study , 1996, MobiCom '96.

[29]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[30]  Staffan Björk,et al.  Pirates! Using the Physical World as a Game Board , 2001, INTERACT.

[31]  Jock D. Mackinlay,et al.  Fluid links for informed and incremental link transitions , 1998, HYPERTEXT '98.

[32]  Hideyuki Tamura,et al.  Mixed Reality: Future Dreams Seen at the Border between Real and Virtual Worlds , 2001, IEEE Computer Graphics and Applications.

[33]  Nuno Correia,et al.  Augmenting reality with geo-referenced information for environmental management , 2002, GIS '02.

[34]  Polle Zellweger,et al.  Scripted documents: a hypermedia path mechanism , 1989, Hypertext.

[35]  Yusuke Ito,et al.  Communication through virtual active objects overlaid onto the real world , 2000, CVE '00.