Seamless Positioning and Navigation by Using Geo-Referenced Images and Multi-Sensor Data

Ubiquitous positioning is considered to be a highly demanding application for today's Location-Based Services (LBS). While satellite-based navigation has achieved great advances in the past few decades, positioning and navigation in indoor scenarios and deep urban areas has remained a challenging topic of substantial research interest. Various strategies have been adopted to fill this gap, within which vision-based methods have attracted growing attention due to the widespread use of cameras on mobile devices. However, current vision-based methods using image processing have yet to revealed their full potential for navigation applications and are insufficient in many aspects. Therefore in this paper, we present a hybrid image-based positioning system that is intended to provide seamless position solution in six degrees of freedom (6DoF) for location-based services in both outdoor and indoor environments. It mainly uses visual sensor input to match with geo-referenced images for image-based positioning resolution, and also takes advantage of multiple onboard sensors, including the built-in GPS receiver and digital compass to assist visual methods. Experiments demonstrate that such a system can greatly improve the position accuracy for areas where the GPS signal is negatively affected (such as in urban canyons), and it also provides excellent position accuracy for indoor environments.

[1]  Kirsi Virrantaus,et al.  3D Smartphone Navigation Using Geocoded Images , 2012 .

[2]  Stuart Robson,et al.  Close Range Photogrammetry: Principles, Methods and Applications , 2006 .

[3]  James J. Little,et al.  /spl sigma/SLAM: stereo vision SLAM using the Rao-Blackwellised particle filter and a novel mixture proposal distribution , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[4]  Pawel Strumillo,et al.  Enhancing Positioning Accuracy in Urban Terrain by Fusing Data from a GPS Receiver, Inertial Sensors, Stereo-Camera and Digital Maps for Pedestrian Navigation , 2012, Sensors.

[5]  Yuwei Chen,et al.  3D personal navigation in smart phone using geocoded images , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[6]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[7]  Luc Van Gool,et al.  Fast wide baseline matching for visual navigation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Roberto Cipolla,et al.  An Image-Based System for Urban Navigation , 2004, BMVC.

[12]  Hassan A. Karimi Universal Navigation on Smartphones , 2011 .

[13]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[14]  Wei Zhang,et al.  Image Based Localization in Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[15]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Gernot A. Fink,et al.  Sift-based Camera Localization using Reference Objects for Application in Multi-camera Environments and Robotics , 2012, ICPRAM.

[17]  Xun Li,et al.  Image matching techniques for vision-based indoor navigation systems: performance analysis for 3D map based approach , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[18]  Girish Chowdhary,et al.  GPS‐denied Indoor and Outdoor Monocular Vision Aided Navigation and Control of Unmanned Aircraft , 2013, J. Field Robotics.

[19]  Zhengjun Liu,et al.  Sensor assisted 3D personal navigation on a smart phone in GPS degraded environments , 2011, 2011 19th International Conference on Geoinformatics.

[20]  Andrew Zisserman,et al.  Multi-view Matching for Unordered Image Sets, or "How Do I Organize My Holiday Snaps?" , 2002, ECCV.

[21]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[22]  Thomas Luhmann,et al.  Precision potential of photogrammetric 6DOF pose estimation with a single camera , 2009 .

[23]  Manfred Wieser,et al.  Navigation: Principles of Positioning and Guidance , 2003 .

[24]  Óscar Cánovas Reverte,et al.  A multisensor LBS using SIFT-based 3D models , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[25]  Ling Yang,et al.  Outlier Detection for Indoor Vision-Based Navigation Applications , 2011 .

[26]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.