Estimating and Controlling the Uncertainty of Learning Machines

The problem of estimating model uncertainty of learning machines (LMs) is becoming a subject of great interest because of the wide application of such kind of methodologies for solving real-world problems. In this work we will provide a general overview on estimating and controlling uncertainity of LMs, by describing the algorithms, the theory and the empirical methods used to obtain a robust estimation. In the end we address the problem of uncertainty estimation when devices with limited resources are considered for the hardware implementation

[1]  James A. Bucklew,et al.  Support vector machine techniques for nonlinear equalization , 2000, IEEE Trans. Signal Process..

[2]  D. Petri,et al.  Low-power and Low-cost Implementation of SVMs for Smart Sensors , 2005, 2005 IEEE Instrumentationand Measurement Technology Conference Proceedings.

[3]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[4]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[5]  Peter L. Bartlett,et al.  Model Selection and Error Estimation , 2000, Machine Learning.

[6]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[7]  Yuh-Jye Lee,et al.  RSVM: Reduced Support Vector Machines , 2001, SDM.

[8]  Chih-Jen Lin,et al.  A study on reduced support vector machines , 2003, IEEE Trans. Neural Networks.

[9]  Davide Anguita,et al.  Hyperparameter design criteria for support vector classifiers , 2003, Neurocomputing.

[10]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[11]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[12]  Davide Anguita,et al.  Theoretical and Practical Model Selection Methods for Support Vector Classifiers , 2004 .

[13]  Andrea Boni,et al.  Low-Power and Low-Cost Implementation of SVMs for Smart Sensors , 2007, IEEE Transactions on Instrumentation and Measurement.