Constructive Ensemble of RBF Neural Networks and Its Application to Earthquake Prediction

Neural networks ensemble is a hot topic in machine learning community, which can significantly improve the generalization ability of single neural networks. However, the design of ensemble architecture still relies on either a tedious trial-and-error process or the experts' experience. This paper proposes a novel method called CERNN (Constructive Ensemble of RBF Neural Networks), in which the number of individuals, the number of hidden nodes and training epoch of each individual are determined automatically. The generalization performance of CERNN can be improved by using different training subsets and individuals with different architectures. Experiments on UCI datasets demonstrate that CERNN is effective to release the user from the tedious trial-and-error process, so is it when applied to earthquake prediction.

[1]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[3]  Xin Yao,et al.  A constructive algorithm for training cooperative neural network ensembles , 2003, IEEE Trans. Neural Networks.

[4]  Yuan Li,et al.  Earthquake Prediction by RBF Neural Network Ensemble , 2004, ISNN.

[5]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[6]  Xin Yao,et al.  An Improved Constructive Neural Network Ensemble Approach to Medical Diagnoses , 2004, IDEAL.

[7]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[8]  Harry Wechsler,et al.  Face recognition using hybrid classifier systems , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[9]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[10]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.