Image-Based Information Guide on Mobile Devices

We present a prototype of an information guide system to be used outdoor in our campus. It allows a user to find places of interest (e.g., lecture halls and libraries) using a camera phone. We use a database of panoramic views of campus scenes tagged by GPS locations, which can diminish overlapping between views. Panoramic views with the closest locations with the query view are acquired. We exploit a wide-baseline matching technique to match between views. However, due to dissimilarity in viewpoints and presence of repetitive structures, a vast percentage of matches could be false matches. We propose a verification model to effectively eliminate false matches. The true correspondences are chosen for pose recovery and information is then projected onto the image. The system is validated by extensive experiments, with images taken in different seasons, weather, illumination conditions, etc.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Roberto Cipolla,et al.  An Image-Based System for Urban Navigation , 2004, BMVC.

[5]  Shigang Li Localization along routes, based upon iconic and Global Positioning System information in large-scale outdoor environments , 2001, Adv. Robotics.

[6]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[7]  Luc Van Gool,et al.  Wide Baseline Stereo Matching based on Local, Affinely Invariant Regions , 2000, BMVC.

[8]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[9]  Yoshiaki Shirai,et al.  A view-based outdoor navigation using object recognition robust to changes of weather and seasons , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Andrzej Sluzek,et al.  On moment-based local operators for detecting image patterns , 2005, Image Vis. Comput..

[11]  Wei Zhang,et al.  Image Based Localization in Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[12]  Kin Choong Yow,et al.  Image Recognition for Mobile Applications , 2007, 2007 IEEE International Conference on Image Processing.

[13]  Tinne Tuytelaars,et al.  Fast wide baseline matching for visual navigation , 2004, CVPR 2004.

[14]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[15]  Mads Nielsen,et al.  Computer Vision — ECCV 2002 , 2002, Lecture Notes in Computer Science.

[16]  Wei Zhang,et al.  Localization Based on Building Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[17]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[18]  Hongbin Zha,et al.  Coarse-to-fine vision-based localization by indexing scale-Invariant features , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).