VisioMap: Lightweight 3-D Scene Reconstruction Toward Natural Indoor Localization

Most existing proposals for indoor localization are “unnatural,” as they rely on sensing abilities not available to human beings. While such a mismatch causes complications in human–computer interactions and thus potentially reduces the usability and friendliness of a localization service, it is partially entailed by the need for low-cost/effort sensing with resource-limited mobile devices. Fortunately, recent developments in smart glasses (e.g., Google Glasses) signal a trend toward realistic visual sensing and hence make the sensing ability of mobile devices more compatible to that of human users. Leveraging such front-end developments, we propose VisioMap as a natural indoor localization system that intentionally mimics the human skills in visual localization. VisioMap uses very sparse photograph samples to reconstruct 3-D indoor scenes; this is facilitated by the facts that photographs are taken at the eye-level with high stability and regularity, and that the reconstruction is lightweight as it exploits geometric features rather than image pixels. Localization is in turn performed by matching the geometric features extracted online to the reconstructed 3-D scene, making VisioMap: 1) natural to users as they can see the matched 3-D scene and 2) dispensed with the need for dense fingerprints/POIs toward accurate localization.

[1]  Michael Goesele,et al.  Scene Reconstruction and Visualization From Community Photo Collections , 2010, Proceedings of the IEEE.

[2]  Moustafa Youssef,et al.  The Horus WLAN location determination system , 2005, MobiSys '05.

[3]  Petros Spachos,et al.  RSSI-Based Indoor Localization With the Internet of Things , 2018, IEEE Access.

[4]  Petros Spachos,et al.  Microlocation for Smart Buildings in the Era of the Internet of Things: A Survey of Technologies, Techniques, and Approaches , 2018, IEEE Signal Processing Magazine.

[5]  Jana Kosecka,et al.  Detection and matching of rectilinear structures , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Justin Manweiler,et al.  Satellites in our pockets: an object positioning system using smartphones , 2012, MobiSys '12.

[7]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Yang Chen,et al.  SnapTask: Towards Efficient Visual Crowdsourcing for Indoor Mapping , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[9]  Zhe Chen,et al.  AWL: Turning Spatial Aliasing From Foe to Friend for Accurate WiFi Localization , 2017, CoNEXT.

[10]  K. J. Ray Liu,et al.  Achieving Centimeter-Accuracy Indoor Localization on WiFi Platforms: A Frequency Hopping Approach , 2016, IEEE Internet of Things Journal.

[11]  Neil W. Bergmann,et al.  Sensor-Assisted Face Recognition System on Smart Glass via Multi-View Sparse Representation Classification , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[12]  Paul Congdon,et al.  Avoiding multipath to revive inbuilding WiFi localization , 2013, MobiSys '13.

[13]  Moustafa Youssef,et al.  CrowdInside: automatic construction of indoor floorplans , 2012, SIGSPATIAL/GIS.

[14]  Thomas F. Stafford,et al.  Mobile commerce: what it is and what it could be , 2003, CACM.

[15]  Chunming Qiao,et al.  Rise of the Indoor Crowd: Reconstruction of Building Interior View via Mobile Crowdsourcing , 2015, SenSys.

[16]  Prabal Dutta,et al.  Luxapose: indoor positioning with mobile phones and visible light , 2014, MobiCom.

[17]  Chunming Qiao,et al.  Crowd Map: Accurate Reconstruction of Indoor Floor Plans from Crowdsourced Sensor-Rich Videos , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[18]  Swati Rallapalli,et al.  Enabling physical analytics in retail stores using smart glasses , 2014, MobiCom.

[19]  Feng Li,et al.  iLocScan: harnessing multipath for simultaneous indoor source localization and space scanning , 2014, SenSys.

[20]  Carlo Fischione,et al.  A Survey of Enabling Technologies for Network Localization, Tracking, and Navigation , 2018, IEEE Communications Surveys & Tutorials.

[21]  Anthony Rowe,et al.  Indoor pseudo-ranging of mobile devices using ultrasonic chirps , 2012, SenSys '12.

[22]  Venkata N. Padmanabhan,et al.  Indoor localization without the pain , 2010, MobiCom.

[23]  Mike Y. Chen,et al.  PalmType: Using Palms as Keyboards for Smart Glasses , 2015, MobileHCI.

[24]  Daniel Cremers,et al.  Semi-dense Visual Odometry for a Monocular Camera , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[26]  Jie Yang,et al.  Push the limit of WiFi based localization for smartphones , 2012, Mobicom '12.

[27]  Kaigui Bian,et al.  Jigsaw: indoor floor plan reconstruction via mobile crowdsensing , 2014, MobiCom.

[28]  Takeo Kanade,et al.  Geometric reasoning for single image structure recovery , 2009, CVPR.

[29]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[31]  Feng Zhao,et al.  A reliable and accurate indoor localization method using phone inertial sensors , 2012, UbiComp.

[32]  Seth J. Teller,et al.  Growing an organic indoor location system , 2010, MobiSys '10.

[33]  Stepán Obdrzálek,et al.  Object Recognition Using Local Affine Frames on Maximally Stable Extremal Regions , 2006, Toward Category-Level Object Recognition.

[34]  Kaigui Bian,et al.  Towards ubiquitous indoor localization service leveraging environmental physical features , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[35]  Yunhao Liu,et al.  Indoor localization via multi-modal sensing on smartphones , 2016, UbiComp.

[36]  Shiwen Mao,et al.  CSI Phase Fingerprinting for Indoor Localization With a Deep Learning Approach , 2016, IEEE Internet of Things Journal.

[37]  Wen Hu,et al.  NaviGlass: Indoor Localisation Using Smart Glasses , 2016, EWSN.

[38]  Ying-Chao Tung,et al.  User-Defined Game Input for Smart Glasses in Public Space , 2015, CHI.

[39]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[40]  Nordin Ramli,et al.  A Hybrid Model Based on Constraint OSELM, Adaptive Weighted SRC and KNN for Large-Scale Indoor Localization , 2019, IEEE Access.

[41]  Sebastian Tilch,et al.  Survey of optical indoor positioning systems , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.