Weighted Data Normalization Based on Eigenvalues for Artificial Neural Network Classification

Artificial neural network (ANN) is a very useful tool in solving learning problems. Boosting the performances of ANN can be mainly concluded from two aspects: optimizing the architecture of ANN and normalizing the raw data for ANN. In this paper, a novel method which improves the effects of ANN by preprocessing the raw data is proposed. It totally leverages the fact that different features should play different roles. The raw data set is firstly preprocessed by principle component analysis (PCA), and then its principle components are weighted by their corresponding eigenvalues. Several aspects of analysis are carried out to analyze its theory and the applicable occasions. Three classification problems are launched by an active learning algorithm to verify the proposed method. From the empirical results, conclusion comes to the fact that the proposed method can significantly improve the performance of ANN.

[1]  I. Jolliffe.  Principal Component Analysis , 2002 .

[2]  C. Furlanello,et al.  Combining local PCA and radial basis function networks for speaker normalization , 1995, Proceedings of 1995 IEEE Workshop on Neural Networks for Signal Processing.

[3]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[4]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[5]  Rong Jin,et al.  Distance Metric Learning: A Comprehensive Survey , 2006 .

[6]  Michael G. Madden,et al.  The Effect of Principal Component Analysis on Machine Learning Accuracy with High Dimensional Spectral Data , 2005, SGAI Conf..

[7]  Shiliang Sun,et al.  Neural network multitask learning for traffic flow forecasting , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[8]  J. Hair.  Multivariate data analysis , 1972 .

[9]  David G. Stork,et al.  Pattern Classification , 1973 .

[10]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[11]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[12]  Daphne Koller,et al.  Active learning: theory and applications , 2001 .

[13]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[14]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[15]  N. Kasabov,et al.  WDN-RBF: weighted data normalization for radial basic function type neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[16]  Shiliang Sun,et al.  Ensemble Learning Methods for Classifying EEG Signals , 2007, MCS.