论文信息 - Ensemble algorithm of neural networks and its application

Ensemble algorithm of neural networks and its application

Neural network ensemble is a very hot topic in both neural networks and machine learning communities (A. Sharkey, 1999). A new approach named BAGAEN is proposed, in which adaptive genetic algorithm and bootstrap algorithms are employed to increase the different degrees among individual RBF neural networks in order to enhance the generalization ability of a neural network system. The training set for individual RBF neural network is generated by the algorithm based on bootstrap and the result can be obtained by using majority voting method or simple averaging method. Experimental results show that BAGAEN has preferable performance in generating ensembles with strong generalization ability. Finally, BAGAEN is applied to predict the magnitude of earthquake.

Yue Liu | Yuan Wang | Bo-Feng Zhang | Geng-Feng Wu

[1] Wei Tang,et al. Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[2] Yoav Freund,et al. Boosting a weak learning algorithm by majority , 1995, COLT '90.

[3] Lars Kai Hansen,et al. Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4] Jiawei Han,et al. Data Mining: Concepts and Techniques , 2000 .

[5] Leo Breiman,et al. Bagging Predictors , 1996, Machine Learning.

[6] Yoav Freund,et al. A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[7] R. Tibshirani,et al. An Introduction to the Bootstrap , 1995 .

[8] Eric Bauer,et al. An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[9] Amanda J. C. Sharkey,et al. Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems , 1999 .

[10] Yoav Freund,et al. A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[11] Anders Krogh,et al. Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[12] Robert E. Schapire,et al. The Strength of Weak Learnability , 1989, 30th Annual Symposium on Foundations of Computer Science.

[13] Chuen-Tsai Sun,et al. Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.