Structural and input reduction in a ESN for robotic navigation tasks

This manuscript aims at showing the effects of feature selection and manifold reduction methods in dealing with the wall-following problem in mobile robotics, a well-known nonlinearly separable classification problem in which sensor recordings are associated to controlled motor responses. The capabilities of state manifold reduction in Echo State Networks (ESNs) through Laplacian Eigenmaps (LEs) are described in terms of noise rejection over the trained weights. Furthermore, various machine learning-based and data mining-based methodologies are applied to show the advantages of using the most informative contents drawn from the original sensor readings.

[1]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[2]  Huan Liu,et al.  Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution , 2003, ICML.

[3]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[4]  Mantas Lukosevicius,et al.  A Practical Guide to Applying Echo State Networks , 2012, Neural Networks: Tricks of the Trade.

[5]  Vince Lyzinski,et al.  Laplacian Eigenmaps From Sparse, Noisy Similarity Measurements , 2016, IEEE Transactions on Signal Processing.

[6]  B. G. Quinn,et al.  The determination of the order of an autoregression , 1979 .

[7]  Guangping Zeng,et al.  Gini coefficient-based task allocation for multi-robot systems with limited energy resources , 2018, IEEE/CAA Journal of Automatica Sinica.

[8]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[9]  Lior Rokach,et al.  Data Mining with Decision Trees - Theory and Applications. 2nd Edition , 2013, Series in Machine Perception and Artificial Intelligence.

[10]  N. Altman.  An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[11]  Svante Wold,et al.  Analysis of variance (ANOVA) , 1989 .

[12]  Jo Campling,et al.  Analysis of Variance (ANOVA) , 2002 .

[13]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[14]  Samina Khalid,et al.  A survey of feature selection and feature extraction techniques in machine learning , 2014, 2014 Science and Information Conference.

[15]  Vitor Santos,et al.  Ensemble Feature Ranking Applied to Medical Data , 2014 .

[16]  Abhaya C. Nayak,et al.  An Empirical Study of a Simple Naive Bayes Classifier Based on Ranking Functions , 2016, Australasian Conference on Artificial Intelligence.

[17]  A. Kingston,et al.  The index of dispersion as a metric of quanta - unravelling the Fano factor. , 2017, Acta crystallographica Section B, Structural science, crystal engineering and materials.

[18]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[19]  Guilherme A. Barreto,et al.  Short-term memory mechanisms in neural network learning of robot navigation tasks: A case study , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[20]  K. Pearson.  On the Criterion that a Given System of Deviations from the Probable in the Case of a Correlated System of Variables is Such that it Can be Reasonably Supposed to have Arisen from Random Sampling , 1900 .

[21]  Ashok Ghatol,et al.  Feature selection for medical diagnosis : Evaluation for cardiovascular diseases , 2013, Expert Syst. Appl..

[22]  Sarah L. Taylor,et al.  Optimizing Echo State Networks for Static Pattern Recognition , 2017, Cognitive Computation.

[23]  Min Han,et al.  Laplacian Echo State Network for Multivariate Time Series Prediction , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Paolo Arena,et al.  Data-based analysis of Laplacian Eigenmaps for manifold reduction in supervised Liquid State classifiers , 2019, Inf. Sci..

[25]  Lior Rokach,et al.  Data Mining with Decision Trees - Theory and Applications , 2007, Series in Machine Perception and Artificial Intelligence.

[26]  Kilian Stoffel,et al.  Theoretical Comparison between the Gini Index and Information Gain Criteria , 2004, Annals of Mathematics and Artificial Intelligence.

[27]  Strother H. Walker,et al.  Estimation of the probability of an event as a function of several independent variables. , 1967, Biometrika.

[28]  Yinghua Lu,et al.  Correlation and redundancy on machine learning performance for chemical databases , 2018 .