The emergence of visual-based localization and navigation using smartphone sensing

The research on localization and navigation has a long history. Traditional location-based services do not work well for indoor environments. The reason is that, compared with outdoors, indoor environments are more complicated and GPS signals are not available. Furthermore, existing indoor localization systems either need to deploy extra devices or are not accurate/reliable. In this paper, we present an emerging research area of mobile crowdsensing — visual-based localization and navigation (VBLN). It makes use of citizen's smartphone cameras and other internal sensors to attain indoor localization and navigation, which proves effective and of low deployment cost. We describe and discuss the generic architecture, its characters, typical applications/systems, key challenges/techniques, as well as the open issues of VBLN.

[1]  Kaigui Bian,et al.  Jigsaw: indoor floor plan reconstruction via mobile crowdsensing , 2014, MobiCom.

[2]  Chadly Marouane,et al.  Indoor positioning using smartphone camera , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[3]  Justin Manweiler,et al.  Satellites in our pockets: an object positioning system using smartphones , 2012, MobiSys '12.

[4]  Qi Han,et al.  Toward real-time and cooperative mobile visual sensing and sharing , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[5]  Jong Weon Lee,et al.  A Hybrid Positioning System for Indoor Navigation on Mobile Phones using Panoramic Images , 2012, KSII Trans. Internet Inf. Syst..

[6]  José Ruíz Ascencio,et al.  Visual simultaneous localization and mapping: a survey , 2012, Artificial Intelligence Review.

[7]  Adam L. Janin,et al.  Multimodal location estimation on Flickr videos , 2011, WSM '11.

[8]  Romit Roy Choudhury,et al.  If you see something, swipe towards it: crowdsourced event localization using smartphones , 2013, UbiComp.

[9]  Yunhao Liu,et al.  SmartGuide: Towards Single-image Building Localization with Smartphone , 2015, MobiHoc.

[10]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[11]  Nicholas A. Giudice,et al.  Indoor magnetic navigation for the blind , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Joy Zhang,et al.  Wi-Fi fingerprinting through active learning using smartphones , 2013, UbiComp.

[13]  Mo Li,et al.  Travi-Navi: Self-Deployable Indoor Navigation System , 2017, TNET.

[14]  Dieter Schmalstieg,et al.  Wide area localization on mobile phones , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[15]  Roberto Cipolla,et al.  An Image-Based System for Urban Navigation , 2004, BMVC.

[16]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[17]  Torsten Sattler,et al.  Fast image-based localization using direct 2D-to-3D matching , 2011, 2011 International Conference on Computer Vision.

[18]  Jiming Chen,et al.  Last-Mile Navigation Using Smartphones , 2015, MobiCom.

[19]  Konrad Tollmar,et al.  Searching the Web with mobile images for location recognition , 2004, CVPR 2004.

[20]  Zhu Wang,et al.  From the internet of things to embedded intelligence , 2013, World Wide Web.

[21]  E. Wang,et al.  iNavigation: an image based indoor navigation system , 2014, Multimedia Tools and Applications.

[22]  Tom Drummond,et al.  Multiple Target Localisation at over 100 FPS , 2009, BMVC.

[23]  Jin Guk Kim,et al.  Panoramic Image-Based Navigation for Smart-Phone in Indoor Environment , 2011, HCI.

[24]  Richard Szeliski,et al.  Alignment of 3D point clouds to overhead images , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[25]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[26]  Jana Kosecka,et al.  Visual Navigation for Mobile Devices , 2010, IEEE MultiMedia.

[27]  Chuan Qin,et al.  TagSense: a smartphone-based approach to automatic image tagging , 2011, MobiSys '11.

[28]  Jean-Arcady Meyer,et al.  Real-time visual loop-closure detection , 2008, 2008 IEEE International Conference on Robotics and Automation.

[29]  Qi Han,et al.  Worker-Contributed Data Utility Measurement for Visual Crowdsensing Systems , 2017, IEEE Transactions on Mobile Computing.

[30]  Bodhi Priyantha,et al.  The Cricket indoor location system , 2005 .

[31]  Moustafa Youssef,et al.  The Horus WLAN location determination system , 2005, MobiSys '05.

[32]  Ravi Jain,et al.  Error characteristics and calibration-free techniques for wireless LAN-based location estimation , 2004, MobiWac '04.

[33]  He Wang,et al.  I am a smartphone and i can tell my user's walking direction , 2014, MobiSys.

[34]  Luc Van Gool,et al.  Fast wide baseline matching for visual navigation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[35]  Vikas Kumar,et al.  CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones , 2010, MobiSys '10.

[36]  Zhu Wang,et al.  Mobile Crowd Sensing and Computing , 2015, ACM Comput. Surv..

[37]  Steven Schockaert,et al.  Finding locations of flickr resources using language models and similarity search , 2011, ICMR.

[38]  Michael Greenspan,et al.  Image Retrieval Using Landmark Indexing for Indoor Navigation , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[39]  Marc Pollefeys,et al.  Never Get Lost Again: Vision Based Navigation Using StreetView Images , 2014, ACCV.

[40]  S. Govindarajulu,et al.  A Comparison of SIFT, PCA-SIFT and SURF , 2012 .

[41]  Yunhao Liu,et al.  Towards Accurate Object Localization with Smartphones , 2014, IEEE Transactions on Parallel and Distributed Systems.

[42]  Steven Mills,et al.  Bag‐of‐words‐driven, single‐camera simultaneous localization and mapping , 2011, J. Field Robotics.

[43]  Kaigui Bian,et al.  Sextant: Towards Ubiquitous Indoor Localization Service by Photo-Taking of the Environment , 2016, IEEE Transactions on Mobile Computing.

[44]  Yunhao Liu,et al.  Indoor localization via multi-modal sensing on smartphones , 2016, UbiComp.

[45]  Wei Zhang,et al.  Image Based Localization in Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[46]  Yunhao Liu,et al.  ppNav: Peer-to-Peer Indoor Navigation for Smartphones , 2016, 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS).