A Novel Dynamic Weight Neural Network Ensemble Model

Neural network is easy to fall into the minimum and over-fitting in the application. The paper proposes a novel dynamic weight neural network ensemble model (DW-NNE). The Bagging algorithm generates certain neural network individuals which then are selected by the k-means clustering algorithm. In addition, for the integrated output problems, the paper proposes a dynamic weight model which is based on fuzzy neural network with accordance to the ideas of dynamic weight. The experimental results show that the integrated approach can achieve better prediction accuracy compared to the traditional single model and neural network ensemble model.

[1]  Anders Krogh,et al.  Learning with ensembles: How overfitting can be useful , 1995, NIPS.

[2]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[3]  Xin Yao,et al.  Simultaneous training of negatively correlated neural networks in an ensemble , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Li Kai,et al.  A Selective Approach to Neural Network Ensemble Based on Clustering Technology , 2005 .

[5]  Yoav Freund,et al.  Boosting a weak learning algorithm by majority , 1995, COLT '90.

[6]  R. Schapire.  The Strength of Weak Learnability , 1990, Machine Learning.

[7]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Kin Keung Lai,et al.  Multistage RBF neural network ensemble learning for exchange rates forecasting , 2008, Neurocomputing.

[9]  David W. Opitz,et al.  Actively Searching for an E(cid:11)ective Neural-Network Ensemble , 1996 .

[10]  Thomas G. Dietterich.  Machine-Learning Research , 1997, AI Mag..

[11]  William B. Yates,et al.  Use of methodological diversity to improve neural network generalisation , 2005, Neural Computing & Applications.

[12]  Yun Zhang,et al.  Design of ensemble neural network using entropy theory , 2011, Adv. Eng. Softw..

[13]  Hou-Kuan Huang,et al.  A selective approach to neural network ensemble based on clustering technology , 2004 .

[14]  Berkman Sahiner,et al.  Dual system approach to computer-aided detection of breast masses on mammograms. , 2006, Medical physics.

[15]  Wu Jian-shengb.  Study on the Stock Market Prediction Model of Neural Ensemble Based on Genetic Algorithms , 2007 .

[16]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[17]  Fabio Roli,et al.  Design of effective neural network ensembles for image classification purposes , 2001, Image Vis. Comput..

[18]  Yu-Bin Yang,et al.  Lung cancer cell identification based on artificial neural network ensembles , 2002, Artif. Intell. Medicine.

[19]  Yun Zhang,et al.  Design of ensemble neural network using the Akaike information criterion , 2008, Eng. Appl. Artif. Intell..

[20]  Min Han,et al.  Remote sensing image classification based on neural network ensemble algorithm , 2012, Neurocomputing.