Stability Evaluation of Combined Neural Networks

In the industrial field, the artificial neural network classifiers are currently used and they are generally integrated of technologic systems which need efficient classifier. However, the lack of control over its mathematical formulation explains the instability of its classification results. In order to improve the prediction accuracy, most of researchers refer to the classifiers combination approach. This paper tries to illustrate the capability of an example of combined neural networks to improve the stability criterion of the single neural classifier. The stability comparison is performed by the error rate probability densities function estimated by a new variant of the kernel-diffeomorphism semi-bounded Plug-in algorithm.

[1]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[2]  Usha A. Kumar,et al.  Comparison of neural networks and regression analysis: A new insight , 2005, Expert Syst. Appl..

[3]  Ibtissem Ben Othman,et al.  The Use of the Modified Semi-bounded Plug-in Algorithm to Compare Neural and Bayesian Classifiers Stability , 2022, International Journal of Neural Networks and Advanced Applications.

[4]  Faouzi Ghorbel,et al.  Some statistical properties of the kernel-diffeomorphism estimator , 1997 .

[5]  Steven K. Rogers,et al.  An Introduction to Biological and Artificial Neural Networks for Pattern Recognition , 1991 .

[6]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[7]  Faouzi Ghorbel,et al.  Non–parametric probability density function estimation on a bounded support: Applications to shape classification and speech coding , 1994 .

[8]  F. Ghorbel,et al.  The Generalised Plug-in Algorithm for the Diffeomorphism Kernel Estimate , 2021, International Journal of Mathematics and Computers in Simulation.

[9]  Faouzi Ghorbel Towards a unitary formulation for invariant image description: application to image coding , 1998, Ann. des Télécommunications.

[10]  Mukta Paliwal,et al.  Neural networks and statistical techniques: A review of applications , 2009, Expert Syst. Appl..

[11]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[12]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  R. Lepage,et al.  Les réseaux de neurones artificiels et leurs applications en imagerie et en vision par ordinateur , 2003 .

[14]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[15]  F. Ghorbel,et al.  A new criteria for comparing neural networks and Bayesian classifier , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[16]  Hervé Bourlard,et al.  Generalization and Parameter Estimation in Feedforward Netws: Some Experiments , 1989, NIPS.

[17]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.