Evaluating indoor localization solutions in large environments through competitive benchmarking: The EvAAL-ETRI competition

The increasing demand for services and higher comfort levels inside buildings, together with the rise in time spent indoor, ensure an upward trend in indoor localization demand for the future. Evaluation of indoor localization systems is particularly challenging due to the complexity of such systems and to the variety of solutions adopted and services offered. EvAAL is an international competition aimed at evaluating and assessing indoor localization systems. The fifth edition of EvAAL promotes competitions on indoor localization in large environments. This paper describes its technical aspects, the competing systems and the results.

[1]  Michael Milford,et al.  Biologically inspired SLAM using Wi-Fi , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Stefano Chessa,et al.  Automatic virtual calibration of range-based indoor localization systems , 2012, Wirel. Commun. Mob. Comput..

[3]  Raúl Montoliu,et al.  Comprehensive analysis of distance and similarity measures for Wi-Fi fingerprinting indoor positioning systems , 2015, Expert Syst. Appl..

[4]  Maria João Nicolau,et al.  Wi-Fi fingerprinting in the real world - RTLS@UM at the EvAAL competition , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[5]  Peng Zhang,et al.  Real-time indoor navigation using smartphone sensors , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[6]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[7]  Sangjoon Park,et al.  Advanced Heuristic Drift Elimination for indoor pedestrian navigation , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[8]  Adriano J. C. Moreira,et al.  Combining similarity functions and majority rules for multi-building, multi-floor, WiFi positioning , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[9]  Paolo Barsocchi,et al.  EvAAL, Evaluating AAL Systems through Competitive Benchmarking, the Experience of the 1st Competition , 2011, EvAAL.

[10]  Stefano Chessa,et al.  Evaluating AAL Systems Through Competitive Benchmarking , 2012, Communications in Computer and Information Science.

[11]  Stefano Chessa,et al.  Evaluating AAL Systems Through Competitive Benchmarking. Indoor Localization and Tracking , 2011, Communications in Computer and Information Science.

[12]  Paolo Barsocchi,et al.  Position Recognition to Support Bedsores Prevention , 2013, IEEE Journal of Biomedical and Health Informatics.

[13]  Paolo Barsocchi.  Evaluating Indoor Localization Systems for AAL Environments , 2012, EvAAL.

[14]  Paolo Barsocchi,et al.  Comparing AAL Indoor Localization Systems , 2011, EvAAL.

[15]  Stefan Knauth,et al.  Fingerprint calibrated centroid and scalar product correlation RSSI positioning in large environments , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[16]  Stefano Chessa,et al.  Multisensor Data Fusion for Activity Recognition Based on Reservoir Computing , 2013, EvAAL.

[17]  Stefano Chessa,et al.  Evaluating Ambient Assisted Living Solutions: The Localization Competition , 2013, IEEE Pervasive Computing.

[18]  Keoni Mahelona,et al.  DARPA Grand Challenge , 2007 .

[19]  Jie Liu,et al.  A realistic evaluation and comparison of indoor location technologies: experiences and lessons learned , 2015, IPSN.

[20]  Herbert Peremans,et al.  Localization performance quantification by conditional entropy , 2015, 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[21]  Stefano Chessa,et al.  Evaluation of localization and activity recognition systems for ambient assisted living: The experience of the 2012 EvAAL competition , 2013, J. Ambient Intell. Smart Environ..

[22]  Adolfo Martínez Usó,et al.  UJIIndoorLoc: A new multi-building and multi-floor database for WLAN fingerprint-based indoor localization problems , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[23]  Erina Ferro,et al.  The UniversAAL Platform for AAL (Ambient Assisted Living) , 2015, J. Intell. Syst..

[24]  Shou-De Lin,et al.  A trading agent competition , 2000 .

[25]  Stefano Chessa,et al.  Evaluating AAL solutions through competitive benchmarking : the localization competition , 2012 .