A Fast 3D Indoor-Localization Approach Based on Video Queries

Image-based localization systems are typically used in outdoor environments, as high localization accuracy can be achieved particularly near tall buildings where the GPS signal is weak. Weak GPS signal is also a critical issue for indoor environments. In this paper, we introduce a novel fast 3D Structure-from-Motion (SfM) model based indoor localization approach using videos as queries. Different from an outdoor environment, the captured images in an indoor environment usually contain people, which often leads to an incorrect camera pose estimation. In our approach, we segment out people in the videos by means of an optical flow technique. This way, we filter people in video and complete the captured video for localization. A graph matching based verification is adopted to enhance both the number of images that are registered and the camera pose estimation. Furthermore, we propose an initial correspondence selection method based on local feature ratio test instead of traditional RANSAC which leads to a much faster image registration speed. The extensive experimental results show that our proposed approach has multiple advantages over existing indoor localization systems in terms of accuracy and speed.

[1]  Yuanjie Zheng,et al.  FuzzyMatte: A computationally efficient scheme for interactive matting , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Jianxiong Xiao,et al.  Structuring Visual Words in 3D for Arbitrary-View Object Localization , 2008, ECCV.

[3]  Richard Szeliski,et al.  City-Scale Location Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Daniel P. Huttenlocher,et al.  Location Recognition Using Prioritized Feature Matching , 2010, ECCV.

[5]  Yiqiang Chen,et al.  Transfer Regression Model for Indoor 3D Location Estimation , 2010, MMM.

[6]  Kiyoharu Aizawa,et al.  Image-based indoor positioning system: fast image matching using omnidirectional panoramic images , 2010, MPVA '10.

[7]  Andrew Owens,et al.  Discrete-continuous optimization for large-scale structure from motion , 2011, CVPR.

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  Nicu Sebe,et al.  Where am I in the dark: Exploring active transfer learning on the use of indoor localization based on thermal imaging , 2016, Neurocomputing.

[10]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Liviu Iftode,et al.  Indoor Localization Using Camera Phones , 2006, WMCSA.

[12]  Nicu Sebe,et al.  Knowing Where I Am: Exploiting Multi-Task Learning for Multi-view Indoor Image-based Localization , 2014, BMVC.

[13]  Ralph R. Martin,et al.  SuperMatching: Feature Matching Using Supersymmetric Geometric Constraints , 2013, IEEE Transactions on Visualization and Computer Graphics.

[14]  Horst Bischof,et al.  From structure-from-motion point clouds to fast location recognition , 2009, CVPR.

[15]  Nicu Sebe,et al.  Egocentric Daily Activity Recognition via Multitask Clustering , 2015, IEEE Transactions on Image Processing.

[16]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[17]  Nicu Sebe,et al.  Localize Me Anywhere, Anytime: A Multi-task Point-Retrieval Approach , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Subramanian Ramanathan,et al.  No Matter Where You Are: Flexible Graph-Guided Multi-task Learning for Multi-view Head Pose Classification under Target Motion , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Yi Yang,et al.  Fine-Grained Image Categorization by Localizing TinyObject Parts from Unannotated Images , 2015, ICMR.

[20]  Nicu Sebe,et al.  Memory efficient large-scale image-based localization , 2014, Multimedia Tools and Applications.

[21]  Roberto Cipolla,et al.  An Image-Based System for Urban Navigation , 2004, BMVC.

[22]  Jana Kosecka,et al.  Qualitative image based localization in indoors environments , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[23]  Xun Li,et al.  Image matching techniques for vision-based indoor navigation systems: a 3D map-based approach1 , 2014, J. Locat. Based Serv..

[24]  Meng Wang,et al.  Harvesting visual concepts for image search with complex queries , 2012, ACM Multimedia.

[25]  Xun Li,et al.  Image matching techniques for vision-based indoor navigation systems: performance analysis for 3D map based approach , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[26]  Torsten Sattler,et al.  Fast image-based localization using direct 2D-to-3D matching , 2011, 2011 International Conference on Computer Vision.

[27]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.