Kernel Group Method of Data Handling: Application to Regression Problems

In this paper, a novel Kernel based Soft Computing hybrid viz., Kernel Group Method of Data Handling (KGMDH) is proposed to solve regression problems. In the proposed KGMDH technique, Kernel trick is employed on the input data in order to get Kernel matrix, which in turn becomes input to GMDH. Several experiments are conducted on five benchmark regression datasets to assess the effectiveness of the proposed technique. The results and a statistical t-test conducted thereof indicate that the proposed KGMDH yields more accurate results than the standalone GMDH in most datasets. This is the significant outcome of the study.

[1]  J. Mercer.  Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[2]  Stanley J. Farlow,et al.  Self-Organizing Methods in Modeling: Gmdh Type Algorithms , 1984 .

[3]  R. E. Abdel-Aal,et al.  GMDH-based feature ranking and selection for improved classification of medical data , 2005, J. Biomed. Informatics.

[4]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[5]  Dipti Srinivasan,et al.  Energy demand prediction using GMDH networks , 2008, Neurocomputing.

[6]  Vadlamani Ravi,et al.  Data Mining via Rules Extracted from GMDH: An Application to Predict Churn in Bank Credit Cards , 2010, KES.

[7]  Manas Ranjan Patra,et al.  Software Reliability Prediction Using Group Method of Data Handling , 2009, RSFDGrC.

[8]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[9]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[10]  Guoyin Wang,et al.  Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing , 2013, Lecture Notes in Computer Science.

[11]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[12]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[13]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[14]  A. Cichocki,et al.  Kernel Principal Component Regression with EM Approach to Nonlinear Principal Components Extraction , 2001 .

[15]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[16]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[17]  Józef Korbicz,et al.  A GMDH neural network-based approach to robust fault diagnosis : Application to the DAMADICS benchmark problem , 2006 .

[18]  Ji Zhu,et al.  Quantile Regression in Reproducing Kernel Hilbert Spaces , 2007 .

[19]  Ji Zhu,et al.  Kernel Logistic Regression and the Import Vector Machine , 2001, NIPS.

[20]  Joachim Schult,et al.  Learning polynomial networks for classification of clinical electroencephalograms , 2005, Soft Comput..

[21]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.