Image-Based Localization Aided Indoor Pedestrian Trajectory Estimation Using Smartphones

Accurately determining pedestrian location in indoor environments using consumer smartphones is a significant step in the development of ubiquitous localization services. Many different map-matching methods have been combined with pedestrian dead reckoning (PDR) to achieve low-cost and bias-free pedestrian tracking. However, this works only in areas with dense map constraints and the error accumulates in open areas. In order to achieve reliable localization without map constraints, an improved image-based localization aided pedestrian trajectory estimation method is proposed in this paper. The image-based localization recovers the pose of the camera from the 2D-3D correspondences between the 2D image positions and the 3D points of the scene model, previously reconstructed by a structure-from-motion (SfM) pipeline. This enables us to determine the initial location and eliminate the accumulative error of PDR when an image is successfully registered. However, the image is not always registered since the traditional 2D-to-3D matching rejects more and more correct matches when the scene becomes large. We thus adopt a robust image registration strategy that recovers initially unregistered images by integrating 3D-to-2D search. In the process, the visibility and co-visibility information is adopted to improve the efficiency when searching for the correspondences from both sides. The performance of the proposed method was evaluated through several experiments and the results demonstrate that it can offer highly acceptable pedestrian localization results in long-term tracking, with an error of only 0.56 m, without the need for dedicated infrastructures.

[1]  Liang Chen,et al.  A two-dimensional pedestrian navigation solution aided with a visual gyroscope and a visual odometer , 2013, GPS Solutions.

[2]  Luis Miguel Bergasa,et al.  OpenABLE: An open-source toolbox for application in life-long visual localization of autonomous vehicles , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[3]  Mike R. James Sfm_georef: Automating image measurement of ground control points for SfM-based projects , 2016 .

[4]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[5]  Michal R. Nowicki,et al.  Experimental evaluation of visual place recognition algorithms for personal indoor localization , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[6]  Alessio De Angelis,et al.  A Positioning System Based on Low-Frequency Magnetic Fields , 2016, IEEE Transactions on Industrial Electronics.

[7]  Alexei A. Efros,et al.  IM2GPS: estimating geographic information from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Gamini Dissanayake,et al.  Linear SLAM: A linear solution to the feature-based and pose graph SLAM based on submap joining , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Naser El-Sheimy,et al.  Smartphone-Based Indoor Localization with Bluetooth Low Energy Beacons , 2016, Sensors.

[10]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[11]  Daniel P. Huttenlocher,et al.  Location Recognition Using Prioritized Feature Matching , 2010, ECCV.

[12]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, International Journal of Computer Vision.

[13]  Fredrik Kahl,et al.  Accurate Localization and Pose Estimation for Large 3D Models , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[15]  Torsten Sattler,et al.  Efficient & Effective Prioritized Matching for Large-Scale Image-Based Localization , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Wei Zhang,et al.  Image Based Localization in Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[17]  Mubarak Shah,et al.  Accurate Image Localization Based on Google Maps Street View , 2010, ECCV.

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Jian Wang,et al.  A Floor-Map-Aided WiFi/Pseudo-Odometry Integration Algorithm for an Indoor Positioning System , 2015, Sensors.

[20]  Swarun Kumar,et al.  Accurate indoor localization with zero start-up cost , 2014, MobiCom.

[21]  Pascal Fua,et al.  Worldwide Pose Estimation Using 3D Point Clouds , 2012, ECCV.

[22]  Jianfei Cai,et al.  Efficient image retrieval based mobile indoor localization , 2015, 2015 Visual Communications and Image Processing (VCIP).

[23]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[24]  Tomás Pajdla,et al.  Avoiding Confusing Features in Place Recognition , 2010, ECCV.

[25]  Jong-Suk Choi,et al.  Advanced indoor localization using ultrasonic sensor and digital compass , 2008, 2008 International Conference on Control, Automation and Systems.

[26]  Jean-Marc Odobez,et al.  A Thousand Words in a Scene , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Prabal Dutta,et al.  SurePoint: Exploiting Ultra Wideband Flooding and Diversity to Provide Robust, Scalable, High-Fidelity Indoor Localization: Demo Abstract , 2016, SenSys 2016.

[28]  Jon M. Kleinberg,et al.  Mapping the world's photos , 2009, WWW '09.

[29]  Xin Chen,et al.  City-scale landmark identification on mobile devices , 2011, CVPR 2011.

[30]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[31]  Masatoshi Okutomi,et al.  Visual Place Recognition with Repetitive Structures , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Hao Jiang,et al.  Fusion of WiFi, Smartphone Sensors and Landmarks Using the Kalman Filter for Indoor Localization , 2015, Sensors.

[33]  Robert Harle,et al.  A Survey of Indoor Inertial Positioning Systems for Pedestrians , 2013, IEEE Communications Surveys & Tutorials.

[34]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[35]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[36]  Torsten Sattler,et al.  Camera Pose Voting for Large-Scale Image-Based Localization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  Hao Jiang,et al.  Accurate indoor localization and tracking using mobile phone inertial sensors, WiFi and iBeacon , 2017, 2017 IEEE International Symposium on Inertial Sensors and Systems (INERTIAL).