Some Progress of Supervised Learning

Supervised learning is very important in machine learning. In this paper we discuss some progress of supervised learning. At first, we introduce the basic concept and methods of supervised learning; then explain several typical algorithms of supervised learning in details, the algorithms covered are Bayesian networks, decision tree, k-nearest neighbor, supervised manifold learning and support vector machines; at last we point out several developing directions of supervised learning.

[1]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[2]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[3]  John C. Platt.  Using Analytic QP and Sparseness to Speed Training of Support Vector Machines , 1998, NIPS.

[4]  Sreerama K. Murthy,et al.  Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey , 1998, Data Mining and Knowledge Discovery.

[5]  V. Vapnik.  Estimation of Dependences Based on Empirical Data , 2006 .

[6]  S. Sathiya Keerthi,et al.  Convergence of a Generalized SMO Algorithm for SVM Classifier Design , 2002, Machine Learning.

[7]  Paul M. Mather,et al.  DECISION TREE BASED CLASSIFICATION OF REMOTELY SENSED DATA , 2001 .

[8]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[9]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[10]  Antonio Laganà,et al.  Computational Science and Its Applications – ICCSA 2004 , 2004, Lecture Notes in Computer Science.

[11]  Sung Wook Baik,et al.  A Decision Tree Algorithm for Distributed Data Mining: Towards Network Intrusion Detection , 2004, ICCSA.

[12]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[13]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[14]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[15]  David W. Aha,et al.  A Review and Empirical Evaluation of Feature Weighting Methods for a Class of Lazy Learning Algorithms , 1997, Artificial Intelligence Review.

[16]  Salvatore Ruggieri,et al.  Efficient C4.5 , 2002, IEEE Trans. Knowl. Data Eng..

[17]  Federico Girosi,et al.  Support Vector Machines: Training and Applications , 1997 .

[18]  Constantine D. Spyropoulos,et al.  Machine Learning and Its Applications , 2001, Lecture Notes in Computer Science.

[19]  Matti Pietikäinen,et al.  Supervised Locally Linear Embedding , 2003, ICANN.

[20]  Erkki Oja,et al.  Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003 , 2003, Lecture Notes in Computer Science.

[21]  Thomas Plum,et al.  Efficient C , 1985 .

[22]  Onur Dikmen,et al.  Parallel univariate decision trees , 2007, Pattern Recognit. Lett..