A versatile large-scale multimodal VR system for cultural heritage visualization

We describe the development and evaluation of a large-scale multimodal virtual reality simulation suitable for the visualization of cultural heritage sites and architectural planning. The system is demonstrated with a reconstruction of an ancient Greek temple in Messene that was created as part of a EU funded cultural heritage project (CREATE). The system utilizes a CAVE-like theatre consisting of head-tracked user localization, a haptic interface with two arms, and 3D sound. The haptic interface was coupled with a realistic physics engine allowing users to experience and fully appreciate the effort involved in the construction of architectural components and their changes through the ages. Initial user-based studies were carried out, to evaluate the usability and performance of the system. A simple task of stacking blocks was used to compare errors and timing in a haptics-enabled system with a haptics-disabled system. In addition, a qualitative study of the final system took place while it was installed in a museum.

[1]  J. Edward Colgate,et al.  Haptic interfaces for virtual environment and teleoperator systems , 1995 .

[2]  Blake Hannaford,et al.  Manipulation in real, virtual and remote environments , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[3]  William Harwin,et al.  Quantification of the effects of haptic feedback during motor skills tasks in a simulated environment , 2000 .

[4]  Massimo Bergamasco,et al.  Art Touch with CREATE haptic interface , 2003 .

[5]  G. Jansson,et al.  Haptic identification of objects with different numbers of fingers , 2004 .

[6]  Vincent Hayward,et al.  Performance Measures for Haptic Interfaces , 1996 .

[7]  Maria Roussou,et al.  Can VR be Useful and Usable in Real-World Contexts? Observations from the Application and Evaluation of VR in Realistic Usage Conditions , 2005 .

[8]  Céline Loscos,et al.  How to use physical parameters coming from the haptic device itself to enhance the evaluation of haptic benefits in user interface , 2003 .

[9]  Grigore C. Burdea,et al.  Force and Touch Feedback for Virtual Reality , 1996 .

[10]  Antonio Frisoli,et al.  The Museum of Pure Form: touching real statues in an immersive virtual museum , 2004, VAST.

[11]  Maria Roussou,et al.  Design and Evaluation of a Real-World Virtual Environment for Architecture and Urban Planning , 2007, PRESENCE: Teleoperators and Virtual Environments.

[12]  Hitoshi Maekawa,et al.  Haptic display for object grasping and manipulating in virtual environment , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[13]  David Swapp,et al.  Interaction with co-located haptic feedback in virtual reality , 2006, Virtual Reality.

[14]  Maria Roussou,et al.  Photorealism and Non-Photorealism in Virtual Heritage Representation , 2003, VAST.

[15]  George Drettakis,et al.  Perceptual audio rendering of complex virtual environments , 2004, ACM Trans. Graph..

[16]  Ming C. Lin,et al.  Contact Determination for Real-time Haptic Interaction in 3D Modeling, Editing and Painting , 2007 .

[17]  Antonio Frisoli,et al.  Evaluation of the Pure-Form haptic displays used for exploration of works of art at museums. , 2005 .

[18]  Mandayam A. Srinivasan,et al.  Force Shading for Haptic Shape Perception , 1996, Dynamic Systems and Control.

[19]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[20]  Dale A. Lawrence,et al.  Combined Visual/Haptic Rendering Modes for Scientific Visualization , 1999, Dynamic Systems and Control.

[21]  J. Flanagan,et al.  Hand and brain : the neurophysiology and psychology of hand movements , 1996 .

[22]  John M. Flach,et al.  The Reality of Experience: Gibson's Way , 1998, Presence.

[23]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .