Evaluation of Four Classifiers as Cost Function for Indoor Location Systems

Abstract In our previous research work, we proposed a methodology that uses magnetic-field and multivariate methods to estimate user location in an indoor environment. In this paper, we propose the use of this methodology to evaluate the performance of four different classification algorithms: Random Forest, Nearest Centroid, K Nearest Neighbors and Artificial Neural Networks; each classifier will be considered as a cost function of a genetic algorithm (GA) used in the feature selection process task of the methodology. The motivation to evaluate the algorithms of classification was that several ILSs use a classification algorithm in order to estimate the location of the user, but the classifiers performance vary from application to application. In order to evaluate the performance of each classification algorithm, the following issues were considered: (1) the time of the training phase to obtain the final classification algorithm; (2) the number of features needed for getting the model; (3) the type of the features from the final model; and (4) the sensitivity and specificity of the model. Our results indicate that Nearest centroid is the classfier algorithm that is best suited to be implemented in an end-user application given the obtained results on the evaluated criteria for the indoor location system (ILS).

[1]  Luc Devroye,et al.  Consistency of Random Forests and Other Averaging Classifiers , 2008, J. Mach. Learn. Res..

[2]  Yiqiang Chen,et al.  Power-efficient access-point selection for indoor location estimation , 2006, IEEE Transactions on Knowledge and Data Engineering.

[3]  Ramón F. Brena,et al.  Location Identification Using a Magnetic-field-based FFT Signature , 2013, ANT/SEIT.

[4]  Hideo Makino,et al.  Basic study on indoor location estimation using Visible Light Communication platform , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  John F. Raquet,et al.  Magnetic field navigation in an indoor environment , 2010, 2010 Ubiquitous Positioning Indoor Navigation and Location Based Service.

[6]  Francesco Falciani,et al.  GALGO: an R package for multivariate variable selection using genetic algorithms , 2006, Bioinform..

[7]  Lior Rokach,et al.  Data Mining with Decision Trees - Theory and Applications , 2007, Series in Machine Perception and Artificial Intelligence.

[8]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[9]  A. Mathai,et al.  Understanding and using sensitivity, specificity and predictive values , 2008, Indian journal of ophthalmology.

[10]  Hanan Lutfiyya,et al.  Herecast:an open infrastructure for locationbased services using WiFi , 2005, WiMob'2005), IEEE International Conference on Wireless And Mobile Computing, Networking And Communications, 2005..

[11]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.

[12]  Ramón F. Brena,et al.  Magnetic-Field Feature Extraction for Indoor Location Estimation , 2013, UCAmI.

[13]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[14]  Yuwei Chen,et al.  Bayesian Fusion for Indoor Positioning Using Bluetooth Fingerprints , 2013, Wirel. Pers. Commun..

[15]  Samer S. Saab,et al.  A Standalone RFID Indoor Positioning System Using Passive Tags , 2011, IEEE Transactions on Industrial Electronics.

[16]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[17]  Frederick Eberhardt,et al.  N-1 Experiments Suffice to Determine the Causal Relations Among N Variables , 2006 .

[18]  Ramón F. Brena,et al.  Bluetooth-WiFi based combined positioning algorithm, implementation and experimental evaluation. , 2013 .