Multimodal digital archiving and reproduction of the world cultural heritage "Gion Festival in Kyoto"

We propose a multimodal digital archiving and reproduction of the world cultural heritage "Gion Festival in Kyoto". In this digital museum project, we make "Virtual Kyoto" more highly-developed and detailed, and develop the system where users can experience the things and events related to Gion Festival with several virtual reality technologies. Specifically, we develop the interactive system based on human five senses such as the contents where users can experience high-defined decorations of Yamahoko with visual and haptic senses, the high-quality sounds of the Festival music and the virtual Yamahoko float ceremony in the 3D vision environment combined these contents. "Virtual Kyoto" is 4 dimensionality city model with GIS and VR technologies, and the platform where the aspect of historical city, Kyoto can be rendered from past to present. Therefore, users can select any period and location and experience the contents of histories, cultures, arts and entertainments in "Virtual Kyoto". Moreover, we can not only handle high order contents but also describe many kinds of contents synthesizing them. This paper describes a multimodal digital archiving and reproduction of Gion Festival and virtual experience of parading of floats in detail.

[1]  Takanobu Nishiura,et al.  Multiple Sound Source Localization Based on Inter-Channel Correlation Using a Distributed Microphone System in a Real Environment , 2010, IEICE Trans. Inf. Syst..

[2]  Maria Roussou,et al.  A versatile large-scale multimodal VR system for cultural heritage visualization , 2006, VRST '06.

[3]  Woong Choi,et al.  Virtual Yamahoko parade in virtual Kyoto , 2010, SIGGRAPH '10.

[4]  W K Pratt,et al.  Spectral estimation techniques for the spectral calibration of a color image scanner. , 1976, Applied optics.

[5]  Hiromi T. Tanaka,et al.  A realtime and direct-touch interaction for 3D woven cultural artifact exhibition , 2010, SA '10.

[6]  Junko Kishimoto,et al.  Two-Shot type 6-band still image capturing system using Commercial Digital Camera and Custom Color Filter , 2008, CGIV/MCS.

[7]  Hiromi T. Tanaka,et al.  Development of a High-Definition and Multispectral Image Capturing System for Digital Archiving of Early Modern Tapestries of Kyoto Gion Festival , 2010, 2010 20th International Conference on Pattern Recognition.

[8]  Hiromi T. Tanaka,et al.  Weave pattern modeling of silk-like fabrics from multi-illuminated HDR image analysis , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Kazuyoshi Nomura,et al.  A 3D active touch interaction based on the meso-structure analyzing , 2010, SA '10.

[10]  Cass W. Everitt,et al.  Interactive Order-Independent Transparency , 2001 .

[11]  Hiromi T. Tanaka,et al.  A Texture-Based Direct-Touch Interaction System for 3D Woven Cultural Property Exhibition , 2010, ACCV Workshops.

[12]  Makoto Sato,et al.  Development of String-based Force Display: SPIDAR , 2002 .

[13]  Massimo Bergamasco,et al.  Beyond virtual museums: experiencing immersive virtual reality in real museums , 2010 .

[14]  Satoshi Tanaka,et al.  Reconstruction of Kyoto of the Edo era based on arts and historical documents: 3D urban model based on historical GIS data , 2009, Int. J. Humanit. Arts Comput..