Stability evaluation of neural and Bayesian classifiers: A new insight

Referring to the statistical point of view, we present in this work, a new criterion for evaluating neural networks stability compared to the Bayesian classifier. The stability comparison is performed by the error rate probability densities function estimated by the kernel-diffeomorphism semi-bounded Plug-in algorithm. The Bayesian and combination approaches for neural networks improve the performance and stability degree of the classical neural classifiers.

[1]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[2]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[3]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[4]  Faouzi Ghorbel,et al.  Some statistical properties of the kernel-diffeomorphism estimator , 1997 .

[5]  Usha A. Kumar,et al.  Comparison of neural networks and regression analysis: A new insight , 2005, Expert Syst. Appl..

[6]  Faouzi Ghorbel,et al.  An Iterative Soft Bit Error Rate Estimation of Any Digital Communication Systems Using a Nonparametric Probability Density Function , 2009, EURASIP J. Wirel. Commun. Netw..

[8]  Mukta Paliwal,et al.  Neural networks and statistical techniques: A review of applications , 2009, Expert Syst. Appl..

[9]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[11]  Richard M. Brugger.  Fitting Frequency Distributions: Philosophy and Practice, Parts I and II , 1997 .

[12]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[13]  F. Ghorbel,et al.  A new criteria for comparing neural networks and Bayesian classifier , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[14]  Hervé Bourlard,et al.  Generalization and Parameter Estimation in Feedforward Netws: Some Experiments , 1989, NIPS.

[15]  Berkman Sahiner,et al.  Dual system approach to computer-aided detection of breast masses on mammograms. , 2006, Medical physics.

[16]  Faouzi Ghorbel,et al.  Non–parametric probability density function estimation on a bounded support: Applications to shape classification and speech coding , 1994 .

[17]  F. Ghorbel,et al.  The Generalised Plug-in Algorithm for the Diffeomorphism Kernel Estimate , 2021, International Journal of Mathematics and Computers in Simulation.

[18]  Faouzi Ghorbel.  Towards a unitary formulation for invariant image description: application to image coding , 1998, Ann. des Télécommunications.

[19]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..