Evaluation of Indoor Localisation Systems: Comments on the ISO/IEC 18305 Standard

Indoor localisation systems have been studied in the literature for more than ten years and are starting to approach the market. The absence of standard evaluation methods is one of the obstacles to their adoption outside of customised environments. Specifically, the definition of benchmarking methodologies, common evaluation criteria, standardised methodologies useful to developers, testers, and end users is an open challenge. The need for common benchmarks has been tackled by some initiatives in recent years: EvAAL, EVARILOS, the Microsoft competition and the IPIN competition. The first formal attempt at defining a standard methodology to evaluate indoor localisation systems is the ISO/IEC 18305:2016 International Standard, which defines a complete framework for performing Test&Evaluation of localisation and tracking systems. This work is a first critical reading of the standard, intended to be a key contribution to the activities of the International Standards Committee of IPIN.