An optimized classification algorithm by BP neural network based on PLS and HCA

Due to some correlative or repetitive factors between features or samples with high dimension and large amount of sample data, when traditional back-propagation (BP) neural network is used to solve this classification problem, it will present a series of problems such as network structural redundancy, low learning efficiency, occupation of storage space, consumption of computing time, and so on. All of these problems will restrict the operating efficiency and classification precision of neural network. To avoid them, partial least squares (PLS) algorithm is used to reduce the feature dimension of original data into low-dimensional data as the input of BP neural network, so that it can simplify the structure and accelerate convergence, thus improving the training speed and operating efficiency. In order to improve the classification precision of BP neural network by using hierarchical cluster analysis (HCA), similar samples are put into a sub-class, and some different sub-classes can be obtained. For each sub-class, a different training session can be conducted to find a corresponding precision BP neural network model, and the simulation samples of different sub-classes can be recognized by the corresponding network model. In this paper, the theories of PLS and HCA are combined together with the property of BP neural network, and an optimized classification algorithm by BP neural network based on PLS and HCA (PLS-HCA-BP algorithm) is proposed. The new algorithm is aimed at improving the operating efficiency and classification precision so as to provide a more reliable and more convenient tool for complex pattern classification systems. Three experiments and comparisons with four other algorithms are carried out to verify the superiority of the proposed algorithm, and the results indicate a good picture of the PLS-HCA-BP algorithm, which is worthy of further promotion.

[1]  Zhongzhi Shi,et al.  Neural Network Research Progress and Applications in Forecast , 2008, ISNN.

[2]  Zhang Yifei.  Neural Network Forecasting Model Based on Clustering and Principle Components Analysis , 2005 .

[3]  M. H. Ghaseminezhad,et al.  A novel self-organizing map (SOM) neural network for discrete groups of data clustering , 2011, Appl. Soft Comput..

[4]  E. S. Gopi.  Digital image forgery detection using artificial neural network and independent component analysis , 2007, Appl. Math. Comput..

[5]  Geoffrey E. Hinton,et al.  Learning representations of back-propagation errors , 1986 .

[6]  Jonathan M. Garibaldi,et al.  A novel fuzzy clustering algorithm for the analysis of axillary lymph node tissue sections , 2007, Applied Intelligence.

[7]  Krzysztof Bartecki.  Neural Network-Based PCA: An Application to Approximation of a Distributed Parameter System , 2012, ICAISC.

[8]  Surajit Chattopadhyay,et al.  A factor analysis and neural network‐based validation of the Varotsos–Cracknell theory on the 11‐year solar cycle , 2008 .

[9]  Sang-Hong Lee,et al.  Minimum Feature Selection for Epileptic Seizure Classification using Wavelet-based Feature Extraction and a Fuzzy Neural Network , 2014 .

[10]  Friedhelm Schwenker,et al.  Pattern classification and clustering: A review of partially supervised learning approaches , 2014, Pattern Recognit. Lett..

[11]  D. Kumar,et al.  Classification of Indian meteorological stations using cluster and fuzzy cluster analysis, and Kohonen artificial neural networks , 2007 .

[12]  Hengkun Xie,et al.  Combined use of partial least-squares regression and neural network for residual life estimation of large generator stator insulation , 2007 .

[13]  Bohumír Garlík,et al.  Identification of type daily diagrams of electric consumption based on cluster analysis of multi-dimensional data by neural network , 2013 .

[14]  Liping Zhu,et al.  A Review on Dimension Reduction , 2013, International statistical review = Revue internationale de statistique.

[15]  E. Dam,et al.  Texture Analysis by a PLS Based Method for Combined Feature Extraction and Selection , 2011, MLMI.

[16]  Lili Liu,et al.  Research of neural network algorithm based on factor analysis and cluster analysis , 2011, Neural Computing and Applications.

[17]  Shuangyin Liu,et al.  Study of short-term water quality prediction model based on wavelet neural network , 2013, Math. Comput. Model..

[18]  Hynek Hermansky,et al.  Factor Analysis of Auto-Associative Neural Networks With Application in Speaker Verification , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[20]  Biswajeet Pradhan,et al.  Landslide susceptibility assessment and factor effect analysis: backpropagation artificial neural networks and their comparison with frequency ratio and bivariate logistic regression modelling , 2010, Environ. Model. Softw..

[21]  Mahmoud Omid,et al.  Prognostication of environmental indices in potato production using artificial neural networks , 2013 .

[22]  Said Kenai,et al.  Predicting concrete properties using neural networks (NN) with principal component analysis (PCA) technique , 2012 .

[23]  Xu Xin-Zheng,et al.  Factor Analysis Feature Extraction Algorithm Based on Shannon Entropy , 2011 .

[24]  Engin Avci.  An expert target recognition system using a genetic wavelet neural network , 2012, Applied Intelligence.

[25]  Su Chun-yang.  Elman Neural Network Algorithm Based on PLS , 2010 .

[26]  Yigang He,et al.  A novel approach for analog fault diagnosis based on neural networks and improved kernel PCA , 2011, Neurocomputing.

[27]  Andrew Rawson,et al.  The prediction of soil chemical and physical properties from mid-infrared spectroscopy and combined partial least-squares regression and neural networks (PLS-NN) analysis , 2009 .

[28]  Mario A. Góngora,et al.  Evolutionary algorithms and fuzzy sets for discovering temporal rules , 2013, Int. J. Appl. Math. Comput. Sci..

[29]  Chin-Hui Lee,et al.  Exploiting deep neural networks for detection-based speech recognition , 2013, Neurocomputing.

[30]  Cheng-Jian Lin,et al.  3D reconstruction and face recognition using kernel-based ICA and neural networks , 2011, Expert Syst. Appl..

[31]  Wei Cong,et al.  Anomaly intrusion detection based on PLS feature extraction and core vector machine , 2013, Knowl. Based Syst..

[32]  Zhao Hui-yan.  A neural network approach to occurrence degree forecasting for wheat midge , 2003 .

[33]  S. Sisson,et al.  A comparative review of dimension reduction methods in approximate Bayesian computation , 2012, 1202.3819.

[34]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[35]  Mohammad Reza Mosavi,et al.  Classification of GPS Satellites Using Improved Back Propagation Training Algorithms , 2013, Wirel. Pers. Commun..

[36]  Susana A. Leiva-Valdebenito,et al.  Una revisión de los algoritmos de partición más comunes en el análisis de conglomerados: un estudio comparativo , 2010 .