Classification conducting knowledge acquisition by an evolutionary robust GRBF-NN model

Abstract Diverse machine learning methods have been successfully used to discover classifying rule among classification data. Sometimes, executing a decision may however indirectly alter feature values of the classified objects, further influencing their classes under the discovered classifying rule. Actually, mining such classification conducting knowledge (CC-knowledge) hidden under the decision from related data can be very helpful to future decision-makings. Hence, this paper proposes an evolutionary robust GRBF-NN model to imitate the mathematical mapping between the feature values before and after executing the decision. A dual-loop nested robust training (DNRT) method is correspondingly developed to determine the weights and parameters using M-AdaBoost and NSGAII respectively in the inner and outer loop. Its remarkable merit is that it considers the classification information by integrating the given classifying rule into both training loops, ensuring the reasonability of prediction. In order to enhance the model’s generalization, the outer loop defines a regularized term and regards it as another optimizing objective of NSGAII besides the training error. Finally, several datasets are employed to verify the effectiveness of the proposed method for CC-knowledge acquisition.

[1]  Bo Sun,et al.  A robust multi-class AdaBoost algorithm for mislabeled noisy data , 2016, Knowl. Based Syst..

[2]  Sun Hao,et al.  Combing rough set and RBF neural network for large-scale ship recognition in optical satellite images , 2014 .

[3]  Jung-Hsien Chiang,et al.  A Combination of Rough-Based Feature Selection and RBF Neural Network for Classification Using Gene Expression Data , 2008, IEEE Transactions on NanoBioscience.

[4]  Zhongyi Hu,et al.  Multiple-output support vector regression with a firefly algorithm for interval-valued stock price index forecasting , 2014, Knowl. Based Syst..

[5]  Buyurman Baykal,et al.  Complexity reduction in radial basis function (RBF) networks by using radial B-spline functions , 1998, Neurocomputing.

[6]  Yanping Bai,et al.  Generalized radial basis function neural network based on an improved dynamic particle swarm optimization and AdaBoost algorithm , 2015, Neurocomputing.

[7]  Pedro Antonio Gutiérrez,et al.  Parameter estimation of q-Gaussian Radial Basis Functions Neural Networks with a Hybrid Algorithm for binary classification , 2012, Neurocomputing.

[8]  Erkan Besdok,et al.  A Comparison of RBF Neural Network Training Algorithms for Inertial Sensor Based Terrain Classification , 2009, Sensors.

[9]  Kusum Deep,et al.  Parameter optimization of multi-pass turning using chaotic PSO , 2015, Int. J. Mach. Learn. Cybern..

[10]  Guido Bugmann,et al.  Normalized Gaussian Radial Basis Function networks , 1998, Neurocomputing.

[11]  Haiyang Li,et al.  A Reconstruction Approach to CT with Cauchy RBFs Network , 2004, ISNN.

[12]  Philip S. Yu,et al.  Data Mining: An Overview from a Database Perspective , 1996, IEEE Trans. Knowl. Data Eng..

[13]  Alvise Sommariva,et al.  Meshless cubature over the disk using thin-plate splines , 2008 .

[14]  Raymond Chiong,et al.  Forecasting interval time series using a fully complex-valued RBF neural network with DPSO and PSO algorithms , 2015, Inf. Sci..

[15]  Zongben Xu,et al.  Re-scale AdaBoost for attack detection in collaborative filtering recommender systems , 2015, Knowl. Based Syst..

[16]  Hui Li,et al.  AdaBoost ensemble for financial distress prediction: An empirical comparison with data from Chinese listed companies , 2011, Expert Syst. Appl..

[17]  Bo Wang,et al.  When Ensemble Learning Meets Deep Learning: a New Deep Support Vector Machine for Classification , 2016, Knowl. Based Syst..

[18]  Nor Ashidi Mat Isa,et al.  A GA-based feature selection and parameter optimization of an ANN in diagnosing breast cancer , 2015, Pattern Analysis and Applications.