Multimodal Mixed Reality Interfaces for Visualizing Digital Heritage

We have developed several digital heritage interfaces that utilize Web3D, virtual and augmented reality technologies for visualizing digital heritage in an interactive manner through the use of several different input devices. We propose in this paper an integration of these technologies to provide a novel multimodal mixed reality interface that facilitates the implementation of more interesting digital heritage exhibitions. With such exhibitions participants can switch dynamically between virtual web-based environments to indoor augmented reality environments as well as make use of various multimodal interaction techniques to better explore heritage information in the virtual museum. The museum visitor can potentially experience their digital heritage in the physical sense in the museum, then explore further through the web, visualize this heritage in the round (3D on the web), take that 3D artifact into the augmented reality domain (the real world) and explore it further using various multimodal interfaces.

[1]  Ioannis T. Christou,et al.  Design and development issues for ARCHEOGUIDE: An Augmented Reality based cultural heritage on-site guide , 2001 .

[2]  Martin White,et al.  Usability evaluation of the EPOCH multimodal user interface: designing 3D tangible interactions , 2006, VRST '06.

[3]  Ivan Poupyrev,et al.  The MagicBook: a transitional AR interface , 2001, Comput. Graph..

[4]  Massimo Bergamasco,et al.  Technological approach for cultural heritage: augmented reality , 1999, 8th IEEE International Workshop on Robot and Human Interaction. RO-MAN '99 (Cat. No.99TH8483).

[5]  Tom Molet,et al.  LIFEPLUS: Revival of life in ancient Pompeii, Virtual Systems and Multimedia , 2002 .

[6]  R. Kadobayashi,et al.  VSMM’96 in Gifu Meta-Museum: A Supportive Augmented-Reality Environment for Knowledge Sharing , 1996 .

[7]  Martin White,et al.  The EPOCH Multimodal Interface for Interacting with Digital Heritage Artefacts , 2006, VSMM.

[8]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[9]  Antonio Frisoli,et al.  Haptics technologies and cultural heritage applications , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[10]  Harald Gatermann.  From Vrml to Augmented reality via panorama-integration and eai-java , 2000 .

[11]  Daniel Pletinckx,et al.  Virtual-Reality Heritage Presentation at Ename , 2000, IEEE Multim..

[12]  H. Eskudero,et al.  RETRIEVAL FROM A CULTURAL KNOWLEDGE DATABASE , 2005 .

[13]  Ido Iurgel.  From Another Point of View: Art-E-Fact , 2004, TIDSE.

[14]  Luc Van Gool,et al.  3D MURALE: a multimedia system for archaeology , 2001, VAST '01.

[15]  S. El-Hakim,et al.  The Virtual Museum: Virtualisation of Real Historical Environments and Artefacts and Three-Dimensional Shape-Based Searching , 2001 .

[16]  Martin White,et al.  An Interactive Visualisation Interface for Virtual Museums , 2004, VAST.

[17]  Fotis Liarokapis.  Augmented reality interfaces : architectures for visualising and interacting with virtual information , 2005 .

[18]  N. Magnenat-Thalmann,et al.  LIFEPLUS : Revival of life in ancient Pompeii , 2002 .

[19]  Martin White,et al.  Exploring and Interacting with Virtual Museums , 2005 .

[20]  Kirk Martinez,et al.  Adaptive Hypermedia in Augmented Reality , 2001 .