A tracking framework for augmented reality tours on cultural heritage sites

Visual tracking for augmented reality tours is still challenging for cultural heritage sites because of the great variation of tracking targets and environments on such sites. Even at today's state of the art, it is almost impossible to apply just one tracking method to all the various environments with any hope of success. This paper presents a tracking framework to overcome this problem. It consists of different tracking flows, each efficiently using robust visual cues of the target scene. Analysis of the tracking environment enables more practical tracking at the sites. The reliability of the tracking framework is verified through on-site demonstrations at Gyeong-bokgung, the most symbolic cultural heritage site in Korea.

[1]  George Papagiannakis,et al.  Mixing virtual and real scenes in the site of ancient Pompeii: Research Articles , 2005 .

[2]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[4]  Tom Drummond,et al.  Rapid rendering of apparent contours of implicit surfaces for real-time tracking , 2003, BMVC.

[5]  Didier Stricker,et al.  Reality Filtering: A Visual Time Machine in Augmented Reality , 2008, VAST.

[6]  George Papagiannakis,et al.  Mixing virtual and real scenes in the site of ancient Pompeii , 2005, Comput. Animat. Virtual Worlds.

[7]  Axel Pinz,et al.  Robust Pose Estimation from a Planar Target , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Didier Stricker,et al.  Archeoguide: An Augmented Reality Guide for Archaeological Sites , 2002, IEEE Computer Graphics and Applications.

[9]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[10]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[11]  Kangsoo Kim,et al.  Augmented reality tour system for immersive experience of cultural heritage , 2009, VRCAI '09.

[12]  Jong-Il Park,et al.  Automatic confidence adjustment of visual cues in model‐based camera tracking , 2010, Comput. Animat. Virtual Worlds.

[13]  Naokazu Yokoya,et al.  Nara Palace Site Navigator: Device-Independent Human Navigation Using a Networked Shared Database , 2004 .

[14]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[15]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[16]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[17]  Zhigeng Pan,et al.  A Review on Augmented Reality for Virtual Heritage System , 2009, Edutainment.

[18]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[20]  Jong-Il Park,et al.  Automatic confidence adjustment of visual cues in model-based camera tracking , 2010 .

[21]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[22]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Harald Wuest,et al.  Cultural Heritage Layers: Integrating Historic Media in Augmented Reality , 2009, 2009 15th International Conference on Virtual Systems and Multimedia.