Automatic Visual Fingerprinting for Indoor Image-Based Localization Applications

Indoor localization has been an active research area in the last decade. Various localization systems have been proposed based on different types of signals, including but not limited to WiFi, ultrawideband, inertial measurements, and visual signals. Fingerprinting-based methods are among the most popular methods due to their accuracy and ease of deployment. However, a disadvantage to fingerprinting-based methods is the training phase in which fingerprints have to be collected at known locations and stored for future localization inquiries. Recently a few methods have been proposed to alleviate this problem. In this paper, we focus on the possibility of reducing the burden of the training phase for visual (image-based) indoor localization systems by proposing a system that automatically generates the image-location database. The proposed system will be referred to as automatic visual fingerprinting that can be paired with any indoor image-based localization method. We will also validate the proposed system through extensive experiments.

[1]  Biao Huang,et al.  A particle filter based on a constrained sampling method for state estimation , 2012, 2012 15th International Conference on Information Fusion.

[2]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[3]  Shahrokh Valaee,et al.  Received-Signal-Strength-Based Indoor Positioning Using Compressive Sensing , 2012, IEEE Transactions on Mobile Computing.

[4]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[5]  Hauke Strasdat,et al.  Scale Drift-Aware Large Scale Monocular SLAM , 2010, Robotics: Science and Systems.

[6]  Hwee-Xian Tan,et al.  CIMLoc: A crowdsourcing indoor digital map construction system for localization , 2014, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[7]  Wei Tu,et al.  Activity Sequence-Based Indoor Pedestrian Localization Using Smartphones , 2015, IEEE Transactions on Human-Machine Systems.

[8]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[9]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[10]  Shahrokh Valaee,et al.  RSS based indoor localization with limited deployment load , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[11]  Avideh Zakhor,et al.  Image Based Localization in Indoor Environments , 2013, 2013 Fourth International Conference on Computing for Geospatial Research and Application.

[12]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[13]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[14]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[15]  Amir Nakib,et al.  Multi-Layer Perceptron Neural Network and nearest neighbor approaches for indoor localization , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[16]  Chadi Assi,et al.  Profiling-Based Indoor Localization Schemes , 2015, IEEE Systems Journal.

[17]  Biao Huang,et al.  Constrained Bayesian state estimation – A comparative study and a new particle filter based approach , 2010 .

[18]  Shahrokh Valaee,et al.  Semi-supervised logo-based indoor localization using smartphone cameras , 2014, 2014 IEEE 25th Annual International Symposium on Personal, Indoor, and Mobile Radio Communication (PIMRC).

[19]  Ashish Pandharipande,et al.  User localization using ultrasonic presence sensing systems , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[20]  Florian Schweiger,et al.  TUMindoor: An extensive image and point cloud dataset for visual indoor localization and mapping , 2012, 2012 19th IEEE International Conference on Image Processing.

[21]  Augusto Luis Ballardini,et al.  An Indoor Localization System for Telehomecare Applications , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Moustafa Youssef,et al.  SemanticSLAM: Using Environment Landmarks for Unsupervised Indoor Localization , 2016, IEEE Transactions on Mobile Computing.

[23]  Shahrokh Valaee,et al.  Joint Indoor Localization and Radio Map Construction with Limited Deployment Load , 2015, IEEE Transactions on Mobile Computing.

[24]  Peter Pach,et al.  DREAR - Towards Infrastructure-Free Indoor Localization via Dead-Reckoning Enhanced with Activity Recognition , 2014, 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies.

[25]  Han Zou,et al.  Robust Extreme Learning Machine With its Application to Indoor Positioning , 2016, IEEE Transactions on Cybernetics.

[26]  Hongwei Du,et al.  HILL: A Hybrid Indoor Localization Scheme , 2014, 2014 10th International Conference on Mobile Ad-hoc and Sensor Networks.

[27]  Shahrokh Valaee,et al.  Ocrapose: An indoor positioning system using smartphone/tablet cameras and OCR-aided stereo feature matching , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[29]  Eleni Stroulia,et al.  The Smart-Condo: Optimizing Sensor Placement for Indoor Localization , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[30]  Hojung Cha,et al.  Smartphone-Based Collaborative and Autonomous Radio Fingerprinting , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Lei Shu,et al.  ZIL: An Energy-Efficient Indoor Localization System Using ZigBee Radio to Detect WiFi Fingerprints , 2015, IEEE Journal on Selected Areas in Communications.

[32]  Qiang Ye,et al.  RSSI-Based Bluetooth Indoor Localization , 2015, 2015 11th International Conference on Mobile Ad-hoc and Sensor Networks (MSN).

[33]  Jing Liu,et al.  Survey of Wireless Indoor Positioning Techniques and Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Shahrokh Valaee,et al.  A weighted KNN epipolar geometry-based approach for vision-based indoor localization using smartphone cameras , 2014, 2014 IEEE 8th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[35]  Jiming Chen,et al.  Gradient-Based Fingerprinting for Indoor Localization and Tracking , 2016, IEEE Transactions on Industrial Electronics.

[36]  Chengdong Wu,et al.  Indoor robot localization based on wireless sensor networks , 2011, IEEE Transactions on Consumer Electronics.

[37]  Bang Wang,et al.  FinCCM: Fingerprint Crowdsourcing, Clustering and Matching for Indoor Subarea Localization , 2015, IEEE Wireless Communications Letters.

[38]  Katinka Wolter,et al.  A survey of experimental evaluation in indoor localization research , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[39]  Guobin Shen,et al.  Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing , 2015, IEEE Journal on Selected Areas in Communications.