Localization, Beacon Placement and Mapping for Range-Based Indoor Localization Systems

Precise time and location are at the core of many Cyber Physical Systems (CPS) applications, as can be seen by the impact of the Global Positioning System. Indoorlocalization systems will enable applications ranging from navigation, asset tracking and secure device interaction to mixed reality experiences and emergency support(e911). However, indoor environments are full of barriers, which attenuate and scatter signals that make it challenging to provide high coverage in a cost-effective and reliable manner at scale. In this dissertation, we will show steps towards designing scalable indoor localization systems in a systematic manner that perform effectively across unpredictable environments and are compatible with several emerging technologies. Specifically, we focus on the class of range-based beacon technologies because(1) they can provide accurate ranges given line-of-sight, (2) they can instantly determine a location without requiring devices to move long distances and (3) thereare growing standards for range-based technologies such as 802.11mc, BLE5 and ultra-wideband. Unfortunately, installing and mapping beacons is both expensiveand time consuming, which continues to hinder adoption. Further, acquiring location from ranges in realistic settings can be inaccurate and slow when a low density ofbeacons and non-line-of-sight signals are encountered. While having an abundance of beacons increases accuracy and decreases the time to acquire the initial location,it also increases the cost of the system. This thesis aims to lower the barrier to adoption of range-based beacon technologies by reducing the infrastructure requiredwhile maintaining high performance in terms of accuracy and time taken to acquire the location and orientation. Our approach leverages additional sources of locationinformation, like geometrical constraints from floor plans to acquire location with a reduced number of beacons, magnetic sensing to rapidly acquire orientation and visualinertial odometry for setup and continuous tracking. We present techniques for location estimation and system provisioning, including beacon placement and mapgeneration, and show how these techniques apply to CPS applications like mobile augmented reality and first-responder localization.

[1]  Gyula Simon,et al.  Time of Arrival Data Fusion for Source Localization , 2005 .

[2]  Alok Aggarwal,et al.  Efficient, generalized indoor WiFi GraphSLAM , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Brian D. O. Anderson,et al.  A Theory of Network Localization , 2006, IEEE Transactions on Mobile Computing.

[4]  Sanjiv Singh,et al.  Range-only SLAM for robots operating cooperatively with sensor networks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[5]  Xiaojun Qiu,et al.  Geometrical room geometry estimation from room impulse responses , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Sei Ikeda,et al.  Visual SLAM algorithms: a survey from 2010 to 2016 , 2017, IPSJ Transactions on Computer Vision and Applications.

[7]  Elie A. Shammas,et al.  Keyframe-based monocular SLAM: design, survey, and future directions , 2016, Robotics Auton. Syst..

[8]  Mo Li,et al.  Use it free: instantly knowing your phone attitude , 2014, MobiCom.

[9]  Anthony Rowe,et al.  Visual light landmarks for mobile devices , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[10]  Hyun Myung,et al.  Indoor localization using particle filter and map-based NLOS ranging model , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Guobin Shen,et al.  BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices , 2007, SenSys '07.

[12]  Subir Kumar Ghosh,et al.  Approximation algorithms for art gallery problems in polygons , 2010, Discret. Appl. Math..

[13]  Anthony Rowe,et al.  Indoor pseudo-ranging of mobile devices using ultrasonic chirps , 2012, SenSys '12.

[14]  Aanjhan Ranganathan,et al.  Physical-layer Techniques for Secure Proximity Verification and Localization , 2016 .

[15]  Rong Zheng,et al.  Towards Zero-Configuration Indoor Localization Using Asynchronous Acoustic Beacons , 2016, 2016 IEEE Intl Conference on Computational Science and Engineering (CSE) and IEEE Intl Conference on Embedded and Ubiquitous Computing (EUC) and 15th Intl Symposium on Distributed Computing and Applications for Business Engineering (DCABES).

[16]  Anthony Rowe,et al.  Ultrasonic time synchronization and ranging on smartphones , 2015, 21st IEEE Real-Time and Embedded Technology and Applications Symposium.

[17]  Diane L. Souvaine,et al.  An efficient algorithm for guard placement in polygons with holes , 1995, Discret. Comput. Geom..

[18]  Gerhard P. Hancke,et al.  IR-UWB-Based Non-Line-of-Sight Identification in Harsh Environments: Principles and Challenges , 2016, IEEE Transactions on Industrial Informatics.

[19]  Abdelhamid Tayebi,et al.  THE APPLICATION OF RAY-TRACING TO MOBILE LOCALIZATION USING THE DIRECTION OF ARRIVAL AND RECEIVED SIGNAL STRENGTH IN MULTIPATH INDOOR ENVIRONMENTS , 2009 .

[20]  Julius O. Smith,et al.  Closed-form least-squares source location estimation from range-difference measurements , 1987, IEEE Trans. Acoust. Speech Signal Process..

[21]  Joachim Hertzberg,et al.  An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments , 2003, Robotics Auton. Syst..

[22]  Joon-Yong Lee,et al.  Accuracy Enhancement for UWB Indoor Positioning Using Ray Tracing , 2006, 2006 IEEE/ION Position, Location, And Navigation Symposium.

[23]  Nuno Pereira,et al.  Enhancing Indoor Smartphone Location Acquisition Using Floor Plans , 2018, 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[24]  Willy Hereman,et al.  Statistical methods in surveying by trilateration , 1998 .

[25]  Alfred O. Hero,et al.  Relative location estimation in wireless sensor networks , 2003, IEEE Trans. Signal Process..

[26]  Hao Wang,et al.  WSN Localization Using RSS in Three-Dimensional Space—A Geometric Method With Closed-Form Solution , 2016, IEEE Sensors Journal.

[27]  Sen Wang,et al.  Keyframe based large-scale indoor localisation using geomagnetic field and motion pattern , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Mark A. Richards,et al.  Fundamentals of Radar Signal Processing , 2005 .

[29]  Andrew Markham,et al.  mID: Tracking and Identifying People with Millimeter Wave Radar , 2019, 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS).

[30]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[31]  Koen Langendoen,et al.  Monte-Carlo Localization for Mobile Wireless Sensor Networks , 2006, MSN.

[32]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[33]  Yu Zhou,et al.  An efficient least-squares trilateration algorithm for mobile robot localization , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  D. T. Lee,et al.  Computational complexity of art gallery problems , 1986, IEEE Trans. Inf. Theory.

[35]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[36]  WADE FOY,et al.  Position-Location Solutions by Taylor-Series Estimation , 1976, IEEE Transactions on Aerospace and Electronic Systems.

[37]  M. Geyer,et al.  Solving passive multilateration equations using Bancroft's algorithm , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[38]  Swarun Kumar,et al.  Decimeter-Level Localization with a Single WiFi Access Point , 2016, NSDI.

[39]  Gerd von Cölln,et al.  Optimization of wireless locating in complex environments by placement of anchor nodes with evolutionary algorithms , 2013, 2013 IEEE 18th Conference on Emerging Technologies & Factory Automation (ETFA).

[40]  Ivan A. Mantilla-Gaviria,et al.  Efficient location strategy for airport surveillance using Mode-S multilateration systems , 2012, International Journal of Microwave and Wireless Technologies.

[41]  Xiaolin Li,et al.  Guoguo: enabling fine-grained indoor localization via smartphone , 2013, MobiSys '13.

[42]  E. Olson,et al.  Robust Range-Only Beacon Localization , 2004, IEEE Journal of Oceanic Engineering.

[43]  Sen Wang,et al.  VidLoc: A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalization , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Anthony Rowe,et al.  Hybrid visible light communication for cameras and low-power embedded devices , 2014, VLCS@MobiCom.

[45]  Fernando Seco Granja,et al.  Optimal Placement of Sensors for Trilateration: Regular Lattices vs Meta-heuristic Solutions , 2007, EUROCAST.

[46]  Pi-Chun Chen,et al.  A non-line-of-sight error mitigation algorithm in location estimation , 1999, WCNC. 1999 IEEE Wireless Communications and Networking Conference (Cat. No.99TH8466).

[47]  Andreas Gebhard,et al.  An acoustic position estimation prototype system for underground mining safety , 2015 .

[48]  Sanjiv Singh,et al.  Preliminary results in range-only localization and mapping , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[49]  Shyamnath Gollakota,et al.  3D Localization for Sub-Centimeter Sized Devices , 2018, SenSys.

[50]  Maurizio A. Spirito,et al.  On the accuracy of cellular mobile station location estimation , 2001, IEEE Trans. Veh. Technol..

[51]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[52]  Yinyu Ye,et al.  Semidefinite programming for ad hoc wireless sensor network localization , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[53]  Xin Wang,et al.  A TOA-based location algorithm reducing the errors due to non-line-of-sight (NLOS) propagation , 2001, IEEE 54th Vehicular Technology Conference. VTC Fall 2001. Proceedings (Cat. No.01CH37211).

[54]  Mohammed Khider,et al.  Simultaneous Localization and Mapping for pedestrians using distortions of the local magnetic field intensity in large indoor environments , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[55]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[56]  Roger Wattenhofer,et al.  SpiderBat: Augmenting wireless sensor networks with distance and angle information , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[57]  B. T. Fang,et al.  Simple solutions for hyperbolic and related position fixes , 1990 .

[58]  Sebastian Thrun,et al.  Sub-meter indoor localization in unmodified environments with inexpensive sensors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Yu Zhou,et al.  A closed-form algorithm for the least-squares trilateration problem , 2010, Robotica.

[60]  Andy Hopper,et al.  Implementing a Sentient Computing System , 2001, Computer.

[61]  Mani B. Srivastava,et al.  The n-Hop Multilateration Primitive for Node Localization Problems , 2003, Mob. Networks Appl..

[62]  Fadel Adib,et al.  Multi-Person Localization via RF Body Reflections , 2015, NSDI.

[63]  Brian D. O. Anderson,et al.  Rigidity, computation, and randomization in network localization , 2004, IEEE INFOCOM 2004.

[64]  Anthony Rowe,et al.  Can a Phone Hear the Shape of a Room? , 2019, 2019 18th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[65]  Sue Whitesides,et al.  The Range Beacon Placement Problem for Robot Navigation , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[66]  Brian D. O. Anderson,et al.  Localization in sparse networks using sweeps , 2006, MobiCom '06.

[67]  Agathoniki Trigoni,et al.  Lightweight map matching for indoor localisation using conditional random fields , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[68]  Javier González,et al.  A pure probabilistic approach to range-only SLAM , 2008, 2008 IEEE International Conference on Robotics and Automation.

[69]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[70]  Paul-Gerhard Plöger,et al.  Robust indoor localization using optimal fusion filter for sensors and map layout information , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[71]  Volkan Isler,et al.  Sensor Placement for Triangulation-Based Localization , 2010, IEEE Transactions on Automation Science and Engineering.

[72]  Nicolaj Kirchhof,et al.  Optimal placement of multiple sensors for localization applications , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[73]  Guy Le Besnerais,et al.  A Robust Indoor/Outdoor Navigation Filter Fusing Data from Vision and Magneto-Inertial Measurement Unit , 2017, Sensors.

[74]  Neal Patwari,et al.  Radio Tomographic Imaging with Wireless Networks , 2010, IEEE Transactions on Mobile Computing.

[75]  Mounir Ghogho,et al.  Effects of anchor placement on mean-CRB for localization , 2011, 2011 The 10th IFIP Annual Mediterranean Ad Hoc Networking Workshop.

[76]  Michael J. Rycroft,et al.  Understanding GPS. Principles and Applications , 1997 .

[77]  Bodhi Priyantha,et al.  The Cricket indoor location system , 2005 .

[78]  Ram Dantu,et al.  LocateMe , 2013, ACM Trans. Intell. Syst. Technol..

[79]  Moustafa Youssef,et al.  CoSDEO 2016 Keynote: A decade later — Challenges: Device-free passive localization for wireless environments , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[80]  V. Chvátal A combinatorial theorem in plane geometry , 1975 .

[81]  Xinrong Li An Iterative NLOS Mitigation Algorithm for Location Estimation in Sensor Networks , 2022 .

[82]  David C. Moore,et al.  Robust distributed network localization with noisy range measurements , 2004, SenSys '04.

[83]  Frank Hoffmann,et al.  The art gallery theorem for polygons with holes , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[84]  Brian D. O. Anderson,et al.  Optimality analysis of sensor-target localization geometries , 2010, Autom..

[85]  Sanjiv Singh,et al.  A Robust Method of Localization and Mapping Using Only Range , 2008, ISER.

[86]  Sakari Tervo,et al.  3D room geometry estimation from measured impulse responses , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[87]  Moe Z. Win,et al.  Network Navigation: Theory and Interpretation , 2012, IEEE Journal on Selected Areas in Communications.

[88]  Jan Boehm,et al.  MOBILE LASER SCANNING FOR INDOOR MODELLING , 2013 .

[89]  John J. Leonard,et al.  Pure range-only sub-sea SLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[90]  Yang Li,et al.  Simultaneous Localization and Mapping with Power Network Electromagnetic Field , 2018, MobiCom.

[91]  Sebastian Thrun,et al.  3-Axis magnetic field mapping and fusion for indoor localization , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[92]  R.L. Moses,et al.  Locating the nodes: cooperative localization in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[93]  Alex Polacco,et al.  THE AMAZON GO CONCEPT : IMPLICATIONS , APPLICATIONS , AND SUSTAINABILITY , 2017 .

[94]  Gerhard P. Hancke,et al.  Practical challenges of IR-UWB based ranging in harsh industrial environments , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[95]  Christian Schindelhauer,et al.  Acoustic Self-Calibrating System for Indoor Smart Phone Tracking , 2015 .

[96]  Geoffrey Blewitt,et al.  Basics of the GPS Technique : Observation Equations , 2000 .

[97]  Sisi Zlatanova,et al.  FIRST EXPERIMENTS WITH THE TANGO TABLET FOR INDOOR SCANNING , 2016 .

[98]  Hansol Kim,et al.  Indoor Positioning System Using Magnetic Field Map Navigation and an Encoder System , 2017, Sensors.

[99]  Bruno Sinopoli,et al.  ALPS: A Bluetooth and Ultrasound Platform for Mapping and Localization , 2015, SenSys.

[100]  Avideh Zakhor,et al.  Simultaneous fingerprinting and mapping for multimodal image and WiFi indoor positioning , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[101]  Yunhao Liu,et al.  Quality of Trilateration: Confidence-Based Iterative Localization , 2008, IEEE Transactions on Parallel and Distributed Systems.

[102]  Suprakash Datta,et al.  Localization in wireless sensor networks , 2007, IPSN.

[103]  Aníbal Ollero,et al.  Undelayed 3D RO-SLAM based on Gaussian-mixture and reduced spherical parametrization , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[104]  Prabal Dutta,et al.  Slocalization: Sub-uW Ultra Wideband Backscatter Localization , 2018, 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[105]  Sanjiv Singh,et al.  Experimental results in range-only localization with radio , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[106]  Fadel Adib,et al.  3D Backscatter Localization for Fine-Grained Robotics , 2019, NSDI.

[107]  Brian Okorn,et al.  Toward Automated Modeling of Floor Plans , 2010 .

[108]  Prabal Dutta,et al.  PolyPoint: Guiding Indoor Quadrotors with Ultra-Wideband Localization , 2015, HotWireless@MobiCom.

[109]  Tin Kam Ho,et al.  Depth camera SLAM on a low-cost WiFi mapping robot , 2012, 2012 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[110]  Dali Sun,et al.  Multi-robot Range-Only SLAM by Active Sensor Nodes for Urban Search and Rescue , 2008, RoboCup.

[111]  Prabal Dutta,et al.  SurePoint: Exploiting Ultra Wideband Flooding and Diversity to Provide Robust, Scalable, High-Fidelity Indoor Localization , 2016, SenSys.

[112]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[113]  David Evans,et al.  Localization for mobile sensor networks , 2004, MobiCom '04.

[114]  David Blaauw,et al.  Harmonium , 2018, ACM Trans. Sens. Networks.

[115]  Mohammed Ziaur Rahman Beyond Trilateration: GPS Positioning Geometry and Analytical Accuracy , 2012 .

[116]  Xiaolin Li,et al.  Towards accurate acoustic localization on a smartphone , 2013, 2013 Proceedings IEEE INFOCOM.

[117]  Aníbal Ollero,et al.  A general Gaussian-mixture approach for range-only mapping using multiple hypotheses , 2010, 2010 IEEE International Conference on Robotics and Automation.

[118]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[119]  Stephan Eidenbenz,et al.  Inapproximability Results for Guarding Polygons and Terrains , 2001, Algorithmica.

[120]  Nando de Freitas,et al.  Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks , 2000, UAI.

[121]  Jerry L. Eaves,et al.  Principles of Modern Radar , 1987 .

[122]  Guobin Shen,et al.  Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing , 2015, IEEE Journal on Selected Areas in Communications.

[123]  Haiyong Luo,et al.  An indoor self-localization algorithm using the calibration of the online magnetic fingerprints and indoor landmarks , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[124]  Roberto Cipolla,et al.  PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[125]  Prabal Dutta,et al.  Luxapose: indoor positioning with mobile phones and visible light , 2014, MobiCom.

[126]  Hujun Bao,et al.  Robust Keyframe-Based Monocular SLAM for Augmented Reality , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[127]  Sen Wang,et al.  Increasing the efficiency of 6-DoF visual localization using multi-modal sensory data , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[128]  Anthony Rowe,et al.  Improving Augmented Reality Relocalization Using Beacons and Magnetic Field Maps , 2019, 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[129]  D. E. Manolakis,et al.  Efficient solution and performance analysis of 3-D position estimation by trilateration , 1996 .

[130]  Eckehard Steinbach,et al.  Graph-based data fusion of pedometer and WiFi measurements for mobile indoor positioning , 2014, UbiComp.