A Realtime and Direct-Touch Interaction System for the 3D Cultural Artifact Exhibition

We propose a realtime and direct-touch interaction system for 3D cultural artifact exhibition based on a texture-based haptic rendering technique. In the field of digital archive, it is important to archive and exhibit the cultural artifact at the high-definition. To archive the shape, color and texture of the cultural artifact, it is important to archive and represent not only visual effect but haptic impression. Therefore, multimodal digital archiving, realtime multisensory rendering, and intuitive and immersive exhibition system are necessary. Therefore, we develop a realtime and direct-touch interaction system for the 3D cultural artifact exhibition based on a texture-based haptic rendering technique. In our system, the viewer can directly touch a stereoscopic vision of 3D digital archived cultural artifact with the string-based and scalable haptic interface device "SPIDAR" and vibration motor.

[1]  Massimo Bergamasco,et al.  Beyond virtual museums: experiencing immersive virtual reality in real museums , 2010 .

[2]  Colin Ware,et al.  Eye-hand co-ordination with force feedback , 2000, CHI.

[3]  Christopher M. Brown,et al.  Haptics in augmented reality , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[4]  Christian Sandor,et al.  Exploring Visuo-Haptic Mixed Reality , 2007 .

[5]  Colin Ware,et al.  The Importance of Stereo and Eye-Coupled Perspective for Eye-Hand Coordination in Fish Tank VR , 2004, Presence: Teleoperators & Virtual Environments.

[6]  Kouta Minamizawa,et al.  RePro3D: full-parallax 3D display using retro-reflective projection technology , 2010, SIGGRAPH '10.

[7]  Marc M. Sebrechts,et al.  HANDBOOK OF VIRTUAL ENVIRONMENTS , 2014 .

[8]  Christian Sandor,et al.  Visuo-Haptic Systems: Half-Mirrors Considered Harmful , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[9]  Isabel Navazo Álvaro,et al.  Rendering detailed haptic textures , 2005 .

[10]  Woong Choi,et al.  Multimodal digital archiving and reproduction of the world cultural heritage "Gion Festival in Kyoto" , 2010, VRCAI '10.

[11]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[12]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[13]  Gábor Székely,et al.  High Precision Augmented Reality Haptics , 2006 .

[14]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[15]  Christopher R. Johnson,et al.  A comprehensive calibration and registration procedure for the Visual Haptic Workbench , 2003 .

[16]  Cagatay Basdogan,et al.  Haptic Rendering in Virtual Environments , 2002 .

[17]  Masahiko Inami,et al.  Visuo-haptic display using head-mounted projector , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[18]  Maria Roussou,et al.  A versatile large-scale multimodal VR system for cultural heritage visualization , 2006, VRST '06.

[19]  Charles Hansen,et al.  The Visualization Handbook , 2011 .

[20]  Hiromi T. Tanaka,et al.  Weave pattern modeling of silk-like fabrics from multi-illuminated HDR image analysis , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.