A SOCP-Based Automatic Visual Fingerprinting Method for Indoor Localization System

With the development of fingerprinting-based visual localization technology, a problem with this method is standing out, which is it takes great expenses in fingerprint collection. Recently, a few studies proposed some methods to alleviate this problem. However, the accuracy of the existing method is relatively low under some scenarios such as wide field of vision. In this paper, we propose a novel automatic visual fingerprinting (AVF) method for an indoor visual localization system. We consider the performance of AVF greatly hinges on visual odometry (VO) and ego-motion estimation (EME) block, which are two different ways of estimating fingerprint coordinates. Since both visual odometry and ego-motion estimation model are inaccurate, we build the least square model by second-order cone programming (SOCP). Our SOCP-based method is proposed to deal with the serious cumulative error and the random error introduced by VO and EME model, respectively. The purpose of this paper is improving the accuracy of the database generated by the AVF method under wide field of vision scenarios. Although the time costs are relatively higher than our compared method, fortunately, it is only on the off-line stage. The simulation results show that our method can provide a reliable image-location database with the consumer-grade smartphone camera.

[1]  Avideh Zakhor,et al.  Reduced-complexity data acquisition system for image-based localization in indoor environments , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[2]  Yang Hong,et al.  A vision-based indoor positioning method with high accuracy and efficiency based on self-optimized-ordered visual vocabulary , 2016, 2016 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[3]  Shahrokh Valaee,et al.  Semi-supervised logo-based indoor localization using smartphone cameras , 2014, 2014 IEEE 25th Annual International Symposium on Personal, Indoor, and Mobile Radio Communication (PIMRC).

[4]  Wen-Hsiang Tsai,et al.  Vision-Based Autonomous Vehicle Guidance for Indoor Security Patrolling by a SIFT-Based Vehicle-Localization Technique , 2010, IEEE Transactions on Vehicular Technology.

[5]  Shahrokh Valaee,et al.  2DTriPnP: A Robust Two-Dimensional Method for Fine Visual Localization Using Google Streetview Database , 2017, IEEE Transactions on Vehicular Technology.

[6]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[7]  Jaap H van Dieën,et al.  The effects of stride length and stride frequency on trunk coordination in human walking. , 2010, Gait & posture.

[8]  Florian Schweiger,et al.  TUMindoor: An extensive image and point cloud dataset for visual indoor localization and mapping , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  Christoforos Panayiotou,et al.  3D Ray Tracing for device-independent fingerprint-based positioning in WLANs , 2012, 2012 9th Workshop on Positioning, Navigation and Communication.

[10]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[11]  Lei Shu,et al.  Path-Loss-Based Fingerprint Localization Approach for Location-Based Services in Indoor Environments , 2017, IEEE Access.

[12]  Shahrokh Valaee,et al.  A weighted KNN epipolar geometry-based approach for vision-based indoor localization using smartphone cameras , 2014, 2014 IEEE 8th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[13]  Atsuto Maki,et al.  Towards a simulation driven stereo vision system , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[14]  Avideh Zakhor,et al.  Image Based Localization in Indoor Environments , 2013, 2013 Fourth International Conference on Computing for Geospatial Research and Application.

[15]  Chong-Min Kyung,et al.  Design and Implementation of Practical Step Detection Algorithm for Wrist-Worn Devices , 2016, IEEE Sensors Journal.

[16]  Valentina Bianchi,et al.  RSSI-Based Indoor Localization and Identification for ZigBee Wireless Sensor Networks in Smart Homes , 2019, IEEE Transactions on Instrumentation and Measurement.

[17]  Mun Choon Chan,et al.  MPiLoc: Self-Calibrating Multi-Floor Indoor Localization Exploiting Participatory Sensing , 2018, IEEE Transactions on Mobile Computing.

[18]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[19]  Lin Ma,et al.  A PCLR-GIST Algorithm for Fast Image Retrieval in Visual Indoor Localization System , 2018, 2018 IEEE 87th Vehicular Technology Conference (VTC Spring).

[20]  Shahrokh Valaee,et al.  Automatic Visual Fingerprinting for Indoor Image-Based Localization Applications , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  Francesc Moreno-Noguer,et al.  Exhaustive Linearization for Robust Camera Pose and Focal Length Estimation , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Eckehard G. Steinbach,et al.  Survey of Visual Feature Extraction Algorithms in a Mars-like Environment , 2017, 2017 IEEE International Symposium on Multimedia (ISM).

[24]  Ronald Raulefs,et al.  Recent Advances in Indoor Localization: A Survey on Theoretical Approaches and Applications , 2017, IEEE Communications Surveys & Tutorials.

[25]  Jiming Chen,et al.  Gradient-Based Fingerprinting for Indoor Localization and Tracking , 2016, IEEE Transactions on Industrial Electronics.

[26]  Jinwhan Kim,et al.  Precise Localization and Mapping in Indoor Parking Structures via Parameterized SLAM , 2019, IEEE Transactions on Intelligent Transportation Systems.

[27]  Shahrokh Valaee,et al.  Ocrapose: An indoor positioning system using smartphone/tablet cameras and OCR-aided stereo feature matching , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Aolei Yang,et al.  A New RSS Fingerprinting-Based Location Discovery Method Under Sparse Reference Point Conditions , 2019, IEEE Access.

[29]  Masatoshi Okutomi,et al.  ASPnP: An Accurate and Scalable Solution to the Perspective-n-Point Problem , 2013, IEICE Trans. Inf. Syst..

[30]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[31]  Lin Ma,et al.  Vision-based indoor localization approach based on SURF and landmark , 2016, 2016 International Wireless Communications and Mobile Computing Conference (IWCMC).

[32]  Hongbin Zha,et al.  Coarse-to-fine vision-based localization by indexing scale-Invariant features , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[34]  Seyed Ali Ghorashi,et al.  A Fingerprint Method for Indoor Localization Using Autoencoder Based Deep Extreme Learning Machine , 2018, IEEE Sensors Letters.