Fuzzy Evolutionary Probabilistic Neural Networks

One of the most frequently used models for classification tasks is the Probabilistic Neural Network. Several improvements of the Probabilistic Neural Network have been proposed such as the Evolutionary Probabilistic Neural Network that employs the Particle Swarm Optimization stochastic algorithm for the proper selection of its spread (smoothing) parameters and the prior probabilities. To further improve its performance, a fuzzy class membership function has been incorporated for the weighting of its pattern layer neurons. For each neuron of the pattern layer, a fuzzy class membership weight is computed and it is multiplied to its output in order to magnify or decrease the neuron's signal when applicable. Moreover, a novel scheme for multi---class problems is proposed since the fuzzy membership function can be incorporated only in binary classification tasks. The proposed model is entitled Fuzzy Evolutionary Probabilistic Neural Network and is applied to several real-world benchmark problem with promising results.

[1]  Jiun-Hung Chen,et al.  Fuzzy kernel perceptron , 2002, IEEE Trans. Neural Networks.

[2]  Todor Ganchev,et al.  Locally Recurrent Probabilistic Neural Networks with Application to Speaker Verification , 2004 .

[3]  Chenn-Jung Huang.  A PERFORMANCE ANALYSIS OF CANCER CLASSIFICATION USING FEATURE EXTRACTION AND PROBABILISTIC NEURAL NETWORKS , 2002 .

[4]  Dimitris K. Tasoulis,et al.  Generalized locally recurrent probabilistic neural networks with application to text-independent speaker verification , 2007, Neurocomputing.

[5]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[6]  Nicos G. Pavlidis,et al.  New Self-adaptive Probabilistic Neural Networks in Bioinformatic and Medical Tasks , 2006, Int. J. Artif. Intell. Tools.

[7]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[8]  Eibe Frank,et al.  Evaluating the Replicability of Significance Tests for Comparing Learning Algorithms , 2004, PAKDD.

[9]  David J. Hand,et al.  Kernel Discriminant Analysis , 1983 .

[10]  Allen I. Selverston,et al.  A consideration of invertebrate central pattern generators as computational data bases , 1988, Neural Networks.

[11]  James M. Keller,et al.  Incorporating Fuzzy Membership Functions into the Perceptron Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Michael N. Vrahatis,et al.  Novel Approaches to Probabilistic Neural Networks Through Bagging and Evolutionary Estimating of Prior Probabilities , 2008, Neural Processing Letters.

[13]  Mohammad Bagher Menhaj,et al.  Fuzzy Probabilistic Neural Networks: A Practical Approach to the Implementation of Baysian Classifier , 2001, Fuzzy Days.

[14]  Yoshua Bengio,et al.  Inference for the Generalization Error , 1999, Machine Learning.

[15]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[16]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[17]  Lutz Prechelt,et al.  PROBEN 1 - a set of benchmarks and benchmarking rules for neural network training algorithms , 1994 .

[18]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[19]  Alan F. Murray,et al.  IEEE International Conference on Neural Networks , 1997 .

[20]  Jian Guo,et al.  A Novel Method for Protein Subcellular Localization Based on Boosting and Probabilistic Neural Network , 2004, APBC.

[21]  Gopal Kanji,et al.  100 Statistical Tests , 1994 .

[22]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[23]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[24]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[25]  Lotfi A. Zadeh,et al.  Fuzzy Logic , 2009, Encyclopedia of Complexity and Systems Science.

[26]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.