A Novel Visual Indoor Positioning Method With Efficient Image Deblurring

Aiming to improve the accuracy of visual indoor positioning, an efficient deep multi-patch network based image deblurring algorithm (DMPID) is proposed to eliminate the effect of blurred images on the positioning accuracy. Meanwhile, the self-sorting visual word based image retrieval algorithm and the block based improved eight-point method are also proposed in this paper to improve the retrieval accuracy and positioning accuracy. The proposed image deblurring algorithm adopts the deep multi-patch network and the weight selective sharing scheme to acquire the deblurred images. Then, we propose the self-sorting visual word and add two additional elements representing the relative spatial information into every obtained feature point to utilize the intrinsic relationships between extracted features and physical positions in order to improve the retrieval accuracy. Meanwhile, the visual word filtering is also employed to eliminate redundant visual words and reduce the time consumption of image retrieval. Finally, the position estimation of query camera can be achieved by the epipolar constraint based on the improved eight-point method. Simulation results and performance analysis show that the proposed method can restore the image details effectively and improve the accuracy of visual indoor positioning.

[1]  Wonjun Kim,et al.  Deep Spectral-Spatial Network for Single Image Deblurring , 2020, IEEE Signal Processing Letters.

[2]  Shahrokh Valaee,et al.  Automatic Visual Fingerprinting for Indoor Image-Based Localization Applications , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Qinghua Hu,et al.  Neural Blind Deconvolution Using Deep Priors , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  E. R. Vimina,et al.  Feature fusion method using BoVW framework for enhancing image retrieval , 2019, IET Image Process..

[5]  Kyoung Mu Lee,et al.  Recurrent Neural Networks With Intra-Frame Iterations for Video Deblurring , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  V. K. Govindan,et al.  Enhanced bag of visual words representations for content based image retrieval: a comparative study , 2019, Artificial Intelligence Review.

[7]  Hongdong Li,et al.  Deep Stacked Hierarchical Multi-Patch Network for Image Deblurring , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Lei Wang,et al.  A Probabilistic Approach to Cross-Region Matching-Based Image Retrieval , 2019, IEEE Transactions on Image Processing.

[9]  Ismail El Sayad,et al.  Image Retrieval using BOVW and Relevant Feedback , 2018 .

[10]  Junjun Jiang,et al.  Guided Locality Preserving Feature Matching for Remote Sensing Image Registration , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Torsten Sattler,et al.  InLoc: Indoor Visual Localization with Dense Matching and View Synthesis , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Dongkai Yang,et al.  Visual Indoor Positioning Method Using Image Database , 2018, 2018 Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS).

[13]  Yi Wang,et al.  Scale-Recurrent Network for Deep Image Deblurring , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  A. A. Tehrani,et al.  Binary image matching using scale invariant feature and hough transforms , 2018, 2018 Advances in Science and Engineering Technology International Conferences (ASET).

[15]  Vishal Monga,et al.  Blind Image Deblurring Using Row–Column Sparse Representations , 2017, IEEE Signal Processing Letters.

[16]  Kyoung Mu Lee,et al.  Joint Estimation of Camera Pose, Depth, Deblurring, and Super-Resolution from a Blurred Image Sequence , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Tae Hyun Kim,et al.  Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jie-Tong Zou,et al.  The development of indoor positioning aerial robot based on motion capture system , 2016, 2016 International Conference on Advanced Materials for Science and Engineering (ICAMSE).

[20]  Claudio Piciarelli,et al.  Visual Indoor Localization in Known Environments , 2016, IEEE Signal Processing Letters.

[21]  Narendra Ahuja,et al.  A Comparative Study for Single Image Blind Deblurring , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Randal W. Beard,et al.  Convergence and Complexity Analysis of Recursive-RANSAC: A New Multiple Target Tracking Algorithm , 2016, IEEE Transactions on Automatic Control.

[23]  Michael Greenspan,et al.  Visual indoor positioning with a single camera using PnP , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[24]  Jianfei Cai,et al.  Efficient image retrieval based mobile indoor localization , 2015, 2015 Visual Communications and Image Processing (VCIP).

[25]  Jean Ponce,et al.  Learning a convolutional neural network for non-uniform motion blur removal , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Bernhard Schölkopf,et al.  Learning to Deblur , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Shahrokh Valaee,et al.  A weighted KNN epipolar geometry-based approach for vision-based indoor localization using smartphone cameras , 2014, 2014 IEEE 8th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[29]  Shuqiang Yang,et al.  Outliers Elimination Based Ransac for Fundamental Matrix Estimation , 2013, 2013 International Conference on Virtual Reality and Visualization.

[30]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[31]  Yiming Yang,et al.  A Comparative Study on Feature Selection in Text Categorization , 1997, ICML.

[32]  Xing Zhang,et al.  Continuous Indoor Visual Localization Using a Spatial Model and Constraint , 2020, IEEE Access.

[33]  P. Arulmozhi,et al.  Generation of Visual Patterns from BoVW for Image Retrieval using modified Similarity Score Fusion , 2020 .

[34]  Chao Min,et al.  Blind Deblurring via a Novel Recursive Deep CNN Improved by Wavelet Transform , 2018, IEEE Access.

[35]  Maoguo Gong,et al.  Remote Sensing Image Registration With Modified SIFT and Enhanced Feature Matching , 2017, IEEE Geoscience and Remote Sensing Letters.

[36]  Pravin Karde,et al.  Improved CBIR system using Edge Histogram Descriptor (EHD) and Support Vector Machine (SVM) , 2016, 2016 International Conference on ICT in Business Industry & Government (ICTBIG).

[37]  Carsten Hahn,et al.  DeepMoVIPS: Visual indoor positioning using transfer learning , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[38]  Ya Tian,et al.  Accurate Human Navigation Using Wearable Monocular Visual and Inertial Sensors , 2014, IEEE Transactions on Instrumentation and Measurement.

[39]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[40]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .