Some methods of pre-processing input data for neural networks

Two techniques of data pre-processing for neural networks are considered in this paper: (i) data compression with the application of the principal component analysis method, and (ii) various forms of data scaling. The novelty of this paper is associated with compressed input data scaling by the rotation (by the "stretching") in neural network. This approach can be treated as the new proposition for data pre-processing techniques. The influence of various types of input data pre-processing on the accuracy of neural network results is discussed by using numerical examples for the cases of natural frequency predictions of horizontal vibrations of load-bearing walls. It is concluded that a significant reduction in the neural network prediction errors is possible by conducting the appropriate input data transformation.

[1]  Zenon Waszczyszyn.  Artificial neural networks in civil engineering: another five years of research in Poland , 2017 .

[2]  P. Koprinkova,et al.  Data-scaling problems in neural-network training , 1999 .

[3]  Krystyna Kuźniar,et al.  Neural analysis of vibration problems of real flat buildings and data pre-processing , 2002 .

[4]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[5]  Irina Kļevecka,et al.  Pre-Processing of Input Data of Neural Networks: The Case of Forecasting Telecommunication Network Traffic , 2008 .

[6]  Andrew J. Clark,et al.  Data preprocessing for anomaly based network intrusion detection: A review , 2011, Comput. Secur..

[7]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[8]  Zenon Waszczyszyn,et al.  Neural Networks for the Simulation and Identification Analysis of Buildings Subjected to Paraseismic Excitations , 2007 .

[9]  Zenon Waszczyszyn.  Artificial neural networks in civil and structural engineering: Ten years of research in Poland , 2006 .

[10]  Krystyna Ku,et al.  Data pre-processing in the neural network identification of the modified walls natural frequencies , 2011 .

[11]  Daniele Ramazzotti,et al.  Data Pre-processing , 2016 .

[12]  Dong-Jin Choi,et al.  The effects of data preprocessing in the determination of coagulant dosing rate , 2000 .

[13]  J. Shi.  REDUCING PREDICTION ERROR BY TRANSFORMING INPUT DATA FOR NEURAL NETWORKS , 2000 .

[14]  Wei-Min Shen,et al.  Data Preprocessing and Intelligent Data Analysis , 1997, Intell. Data Anal..

[15]  Zenon Waszczyszyn.  Advances of Soft Computing in Engineering , 2010 .

[16]  Peter Christen,et al.  Data Pre-Processing , 2012 .

[17]  Michael Y. Hu,et al.  Effect of data standardization on neural network training , 1996 .