KPCA SVM with GA Model for Technological Achievements of College Students Forecasting

A two-stage neural network architecture constructed by combining Support Vector Machines (SVM) with kernel principal component analysis (KPCA) and genetic algorithms (GAs) is proposed for technological achievements of college students forecasting. In the first stage, KPCA is used as feature extraction. In the second stage, KPCA SVM is used to regression estimation by finding the most appropriate kernel function and the optimal learning parameters with GAs. By examining the technological achievements data, it is shown that the proposed method achieves both significantly higher prediction performance and faster convergence speed in comparison with a single SVM model. And KPCA SVM outperforms principal component analysis (PCA) SVM.

[1]  D. Zhang,et al.  Principle Component Analysis , 2004 .

[2]  Wenzhi Liao,et al.  Image Feature Extraction Based on Kernel ICA , 2008, 2008 Congress on Image and Signal Processing.

[3]  H. Deutsch.  Principle Component Analysis , 2004 .

[4]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[5]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[6]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[7]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[8]  Andrzej Cichocki,et al.  Kernel PCA for Feature Extraction and De-Noising in Nonlinear Regression , 2001, Neural Computing & Applications.

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  Ping-Feng Pai,et al.  Forecasting regional electricity load based on recurrent support vector machines with genetic algorithms , 2005 .

[11]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[14]  Sam Kwong,et al.  Genetic algorithms and their applications , 1996, IEEE Signal Process. Mag..

[15]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[16]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[17]  Zhenguo Chen,et al.  Minimax Probability Machine Classifier with Feature Extraction by Kernel Pca for Intrusion Detection , 2008, 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing.

[18]  Li Hongwei,et al.  Ad hoc-based feature selection and support vector machine classifier for intrusion detection , 2007, 2007 IEEE International Conference on Grey Systems and Intelligent Services.