Permanent disability classification by combining evolutionary Generalized Radial Basis Function and logistic regression methods

Recently, a novelty multinomial logistic regression method where the initial covariate space is increased by adding the nonlinear transformations of the input variables given by Gaussian Radial Basis Functions (RBFs) obtained by an evolutionary algorithm was proposed. However, there still exist some problems with the standard Gaussian RBF, for example, the approximation of constant valued functions or the approximation of high dimensionality associated to some real problems. In order to face these problems, we propose the use of the generalized Gaussian RBF (GRBF) instead of the standard Gaussian RBF. Our approach has been validated with a real problem of disability classification, to evaluate its effectiveness. Experimental results show that this approach is able to achieve good generalization performance.

[1]  David E. Rumelhart,et al.  Product Units: A Computationally Powerful and Biologically Plausible Extension to Backpropagation Networks , 1989, Neural Computation.

[2]  Pedro Antonio Gutiérrez,et al.  A dynamic over-sampling procedure based on sensitivity for multi-class problems , 2011, Pattern Recognit..

[3]  César Hervás-Martínez,et al.  A two-stage algorithm in evolutionary product unit neural networks for classification , 2011, Expert Syst. Appl..

[4]  Pedro Antonio Gutiérrez,et al.  Classification by Evolutionary Generalized Radial Basis Functions , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[5]  Emilio Corchado,et al.  Soft computing models to identify typical meteorological days , 2011, Log. J. IGPL.

[6]  Pedro Antonio Gutiérrez,et al.  Evolutionary q-Gaussian radial basis function neural networks for multiclassification , 2011, Neural Networks.

[7]  Pedro Antonio Gutiérrez,et al.  Classification by evolutionary generalised radial basis functions , 2010, Int. J. Hybrid Intell. Syst..

[8]  Pedro Antonio Gutiérrez,et al.  MELM-GRBF: A modified version of the extreme learning machine for generalized radial basis function neural networks , 2011, Neurocomputing.

[9]  Chris Bishop,et al.  Improving the Generalization Properties of Radial Basis Function Neural Networks , 1991, Neural Computation.

[10]  César Hervás-Martínez,et al.  Determination of relative agrarian technical efficiency by a dynamic over-sampling procedure guided by minimum sensitivity , 2011, Expert Syst. Appl..

[11]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[12]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[13]  Eibe Frank,et al.  Logistic Model Trees , 2003, ECML.

[14]  Sreejit Chakravarty,et al.  Dynamic filter weights neural network model integrated with differential evolution for day-ahead price forecasting in energy market , 2011, Expert Syst. Appl..

[15]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[16]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[17]  Angel A. Juan,et al.  Special issue on Hybrid Fuzzy Models , 2010, Int. J. Hybrid Intell. Syst..

[18]  Lakhmi C. Jain,et al.  Radial basis function networks 1: recent developments in theory and applications , 2001 .

[19]  Pedro Antonio Gutiérrez,et al.  Evolutionary q-Gaussian Radial Basis Function Neural Network to determine the microbial growth/no growth interface of Staphylococcus aureus , 2011, Appl. Soft Comput..

[20]  Andries P. Engelbrecht,et al.  Pruning product unit neural networks , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[21]  Shi-jie Zheng,et al.  A genetic fuzzy radial basis function neural network for structural health monitoring of composite laminated beams , 2011, Expert Syst. Appl..

[22]  Pedro Antonio Gutiérrez,et al.  Parameter estimation of q-Gaussian Radial Basis Functions Neural Networks with a Hybrid Algorithm for binary classification , 2012, Neurocomputing.

[23]  Asoke K. Nandi,et al.  An extension of the generalized Gaussian distribution to include asymmetry , 1995 .

[24]  Attila Andai,et al.  On the geometry of generalized Gaussian distributions , 2007, J. Multivar. Anal..

[25]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[26]  Pedro Antonio Gutiérrez,et al.  Logistic Regression by Means of Evolutionary Radial Basis Function Neural Networks , 2011, IEEE Transactions on Neural Networks.