ARC-LH: A New Adaptive Resampling Algorithm for Improving ANN Classifiers

We introduce arc-lh, a new algorithm for improvement of ANN classifier performance, which measures the importance of patterns by aggregated network output errors. On several artificial benchmark problems, this algorithm compares favorably with other resample and combine techniques.

[1]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[2]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[3]  Kurt Hornik,et al.  Cross-validation with active pattern selection for neural-network classifiers , 1998, IEEE Trans. Neural Networks.

[4]  Ron Kohavi,et al.  Bias Plus Variance Decomposition for Zero-One Loss Functions , 1996, ICML.

[5]  Shigeki Miyake,et al.  Bayes statistical behavior and valid generalization of pattern classifying neural networks , 1991, IEEE Trans. Neural Networks.

[6]  Robert Tibshirani,et al.  Bias, Variance and Prediction Error for Classification Rules , 1996 .

[7]  Robert Tibshirani,et al.  A Comparison of Some Error Estimates for Neural Network Models , 1996, Neural Computation.

[8]  J. Ross Quinlan,et al.  Bagging, Boosting, and C4.5 , 1996, AAAI/IAAI, Vol. 1.

[9]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[10]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[11]  Kurt Hornik,et al.  NN classifiers: reducing the computational cost of cross-validation by active pattern selection , 1995, Proceedings 1995 Second New Zealand International Two-Stream Conference on Artificial Neural Networks and Expert Systems.

[12]  Petri Koistinen,et al.  Kernel regression and backpropagation training with noise , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[13]  Leo Breiman,et al.  Bias, Variance , And Arcing Classifiers , 1996 .

[14]  Thomas G. Dietterich,et al.  Error-Correcting Output Coding Corrects Bias and Variance , 1995, ICML.

[15]  Leo Breiman,et al.  Stacked regressions , 2004, Machine Learning.

[16]  Corinna Cortes,et al.  Boosting Decision Trees , 1995, NIPS.