Probabilistic neural network training procedure based on Q(0)-learning algorithm in medical data classification

In this article, an iterative procedure is proposed for the training process of the probabilistic neural network (PNN). In each stage of this procedure, the Q(0)-learning algorithm is utilized for the adaptation of PNN smoothing parameter (σ). Four classes of PNN models are regarded in this study. In the case of the first, simplest model, the smoothing parameter takes the form of a scalar; for the second model, σ is a vector whose elements are computed with respect to the class index; the third considered model has the smoothing parameter vector for which all components are determined depending on each input attribute; finally, the last and the most complex of the analyzed networks, uses the matrix of smoothing parameters where each element is dependent on both class and input feature index. The main idea of the presented approach is based on the appropriate update of the smoothing parameter values according to the Q(0)-learning algorithm. The proposed procedure is verified on six repository data sets. The prediction ability of the algorithm is assessed by computing the test accuracy on 10 %, 20 %, 30 %, and 40 % of examples drawn randomly from each input data set. The results are compared with the test accuracy obtained by PNN trained using the conjugate gradient procedure, support vector machine algorithm, gene expression programming classifier, k–Means method, multilayer perceptron, radial basis function neural network and learning vector quantization neural network. It is shown that the presented procedure can be applied to the automatic adaptation of the smoothing parameter of each of the considered PNN models and that this is an alternative training method. PNN trained by the Q(0)-learning based approach constitutes a classifier which can be treated as one of the top models in data classification problems.

[1]  Jun-Geol Baek,et al.  Asynchronous action-reward learning for nonstationary serial supply chain inventory control , 2008, Applied Intelligence.

[2]  Ronald Marsh,et al.  Conjugate gradient and approximate Newton methods for an optimal probabilistic neural network for food color classification , 1998 .

[3]  Maciej Kusy,et al.  Stateless Q-Learning Algorithm for Training of Radial Basis Function Based Neural Networks in Medical Data Classification , 2014 .

[4]  D. F. Specht,et al.  Experience with adaptive probabilistic neural networks and adaptive general regression neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[5]  Nicos G. Pavlidis,et al.  New Self-adaptive Probabilistic Neural Networks in Bioinformatic and Medical Tasks , 2006, Int. J. Artif. Intell. Tools.

[6]  R. Orr,et al.  Use of a Probabilistic Neural Network to Estimate the Risk of Mortality after Cardiac Surgery , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[7]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[8]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[9]  Hojjat Adeli,et al.  A probabilistic neural network for earthquake magnitude prediction , 2009, Neural Networks.

[10]  Salima Nebti,et al.  Handwritten characters recognition based on nature-inspired computing and neuro-evolution , 2012, Applied Intelligence.

[11]  Kenji Doya,et al.  Multiple model-based reinforcement learning explains dopamine neuronal activity , 2007, Neural Networks.

[12]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[13]  Paloma Martínez,et al.  Learning teaching strategies in an Adaptive and Intelligent Educational System through Reinforcement Learning , 2009, Applied Intelligence.

[14]  Hua Zhang,et al.  A new watermarking approach based on probabilistic neural network in wavelet domain , 2008, Soft Comput..

[15]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[16]  Richard S. Johannes,et al.  Using the ADAP Learning Algorithm to Forecast the Onset of Diabetes Mellitus , 1988 .

[17]  Mark Rivera,et al.  Gap-Based Estimation: Choosing the Smoothing Parameters for Probabilistic and General Regression Neural Networks , 2006, Neural Computation.

[18]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[19]  Aluizio F. R. Araújo,et al.  A topological reinforcement learning agent for navigation , 2003, Neural Computing & Applications.

[20]  Biswanath Samanta,et al.  Artificial neural networks and genetic algorithm for bearing fault detection , 2006, Soft Comput..

[21]  Jianghao Li,et al.  Microassembly path planning using reinforcement learning for improving positioning accuracy of a 1 cm3 omni-directional mobile microrobot , 2011, Applied Intelligence.

[22]  Janusz A. Starzyk,et al.  A Novel Optimization Algorithm Based on Reinforcement Learning , 2010 .

[23]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[24]  D. Pregibon,et al.  Graphical Methods for Assessing Logistic Regression Models , 1984 .

[25]  Roland Siegwart,et al.  Title of paper : Compact Q-Learning Optimized for Micro-robots with Processing and Memory Constraints , 2004 .

[26]  Kenji Doya,et al.  Meta-learning in Reinforcement Learning , 2003, Neural Networks.

[27]  Martin A. Riedmiller,et al.  Reinforcement learning on explicitly specified time scales , 2003, Neural Computing & Applications.

[28]  H. Altay Güvenir,et al.  Learning differential diagnosis of erythemato-squamous diseases using voting feature intervals , 1998, Artif. Intell. Medicine.

[29]  Leszek Rutkowski,et al.  Adaptive probabilistic neural networks for pattern classification in time-varying environment , 2004, IEEE Transactions on Neural Networks.

[30]  George C. Anastassopoulos,et al.  Genetic algorithm pruning of probabilistic neural networks in medical disease estimation , 2011, Neural Networks.

[31]  Q. Henry Wu,et al.  High-dimensional Function Optimisation by Reinforcement Learning , 2010, IEEE Congress on Evolutionary Computation.

[32]  Paulo Martins Engel,et al.  An Incremental Probabilistic Neural Network for Regression and Reinforcement Learning Tasks , 2010, ICANN.

[33]  TaeChoong Chung,et al.  Learning via human feedback in continuous state and action spaces , 2013, Applied Intelligence.

[34]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[35]  Mark Beale,et al.  Neural Network Toolbox™ User's Guide , 2015 .

[36]  Cândida Ferreira,et al.  Gene Expression Programming: Mathematical Modeling by an Artificial Intelligence , 2014, Studies in Computational Intelligence.

[37]  Michael N. Vrahatis,et al.  Novel Approaches to Probabilistic Neural Networks Through Bagging and Evolutionary Estimating of Prior Probabilities , 2008, Neural Processing Letters.

[38]  Ilias Maglogiannis,et al.  An intelligent system for automated breast cancer diagnosis and prognosis using SVM based classifiers , 2009, Applied Intelligence.

[39]  Marios S. Pattichis,et al.  Classification of atherosclerotic carotid plaques using morphological analysis on ultrasound images , 2009, Applied Intelligence.

[40]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[42]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[43]  Lúcia Valéria Ramos de Arruda,et al.  Autonomous navigation system using Event Driven-Fuzzy Cognitive Maps , 2011, Applied Intelligence.

[44]  Cândida Ferreira,et al.  Gene Expression Programming: Mathematical Modeling by an Artificial Intelligence (Studies in Computational Intelligence) , 2006 .

[45]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[46]  Donald F. Specht,et al.  Probabilistic neural networks and the polynomial Adaline as complementary techniques for classification , 1990, IEEE Trans. Neural Networks.

[47]  Philip Jonathan,et al.  On the use of cross-validation to assess performance in multivariate prediction , 2000, Stat. Comput..