Practical evaluation and tuning methodology for indoor positioning systems

How do we evaluate the performance of an indoor positioning system? In addition, in which way can the system be optimally tuned for a certain environment? These are the questions addressed in this study. We propose a practical, cost efficient methodology for evaluating and tuning indoor positioning systems. The methodology has two main phases. In the first online recording phase, the ground truth information is gathered, and raw signals are recorded. In the second phase, offline positioning algorithms utilise the recorded information to infer position estimations which can then be precisely evaluated. An automatic parameter optimization methodology, which recommends optimal tunings for the positioning algorithm, is presented as a key utility of this work. An overall advantage of the proposed method is the fact that the recorded data guarantee the repeatability of tests, and allow consistent comparisons among different algorithms, creating the perspective of a testbed based on real data. The implementation of the methodology is exemplified with the presentation of the GpmLab Android application and the GpmStudio desktop platform, tools which assist our main positioning framework, the Global Positioning Module (GPM).

[1]  Ilja Radusch,et al.  Cost-effective camera based ground truth for indoor localization , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[2]  Ingrid Moerman,et al.  Platform for benchmarking of RF-based indoor localization solutions , 2015, IEEE Communications Magazine.

[3]  Christian A. Müller,et al.  Using natural footstep-accurate traces for indoor positioning evaluation , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[4]  Ingrid Moerman,et al.  The EVARILOS Benchmarking Handbook: Evaluation of RF-based Indoor Localization Solutions , 2013 .

[5]  Ian Sharp,et al.  Positional Accuracy Measurement and Error Modeling for Mobile Tracking , 2012, IEEE Transactions on Mobile Computing.

[6]  Simon Schmitt,et al.  Virtual testbed for indoor localization , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[7]  L.C. Perez,et al.  2D tracking performance evaluation using the cricket location-support system , 2005, 2005 IEEE International Conference on Electro Information Technology.

[8]  Michel Deriaz,et al.  Accuracy Enhancements in Indoor Localization with the Weighted Average Technique , 2014 .

[9]  Simon Schmitt,et al.  Path loss and multipath effects in a real world indoor localization scenario , 2014, 2014 11th Workshop on Positioning, Navigation and Communication (WPNC).

[10]  Simon Schmitt,et al.  A reference system for indoor localization testbeds , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[11]  Jie Liu,et al.  A realistic evaluation and comparison of indoor location technologies: experiences and lessons learned , 2015, IPSN.

[12]  Katinka Wolter,et al.  A survey of experimental evaluation in indoor localization research , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[13]  Victor Bayon,et al.  An instrumentation and analytics framework for optimal and robust NFV deployment , 2015, IEEE Communications Magazine.

[14]  Stefano Chessa,et al.  Evaluating AAL solutions through competitive benchmarking : the localization competition , 2012 .

[15]  Simon Schmitt,et al.  Experimental evaluation of indoor localization algorithms , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[16]  Teemu Pulkkinen,et al.  Evaluating indoor positioning errors , 2015, 2015 International Conference on Information and Communication Technology Convergence (ICTC).

[17]  Michel Deriaz,et al.  Harmonization of position providers , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[18]  Simon Schmitt,et al.  Experimental evaluation of the spatial error distribution of indoor localization algorithms , 2014, 2014 Ubiquitous Positioning Indoor Navigation and Location Based Service (UPINLBS).

[19]  Stefano Chessa,et al.  Evaluating Ambient Assisted Living Solutions: The Localization Competition , 2013, IEEE Pervasive Computing.

[20]  Michel Deriaz,et al.  Positioning evaluation and ground truth definition for real life use cases , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).