A New Back-Propagation Neural Network Algorithm for a Big Data Environment Based on Punishing Characterized Active Learning Strategy

This paper introduces the active learning strategy to the classical back-propagation neural network algorithm and proposes punishing-characterized active learning Back-Propagation BP Algorithm PCAL-BP to adapt to big data conditions. The PCAL-BP algorithm selects samples and punishments based on the absolute value of the prediction error to improve the efficiency of learning complex data. This approach involves reducing learning time and provides high precision. Numerical analysis shows that the PCAL-BP algorithm is superior to the classical BP neural network algorithm in both learning efficiency and precision. This advantage is more prominent in the case of extensive sample data. In addition, the PCAL-BP algorithm is compared with 16 types of classical classification algorithms. It performs better than 14 types of algorithms in the classification experiment used here. The experimental results also indicate that the prediction accuracy of the PCAL-BP algorithm can continue to increase with an increase in sample size.

[1]  Chuanyi Ji,et al.  Combinations of Weak Classifiers , 1996, NIPS.

[2]  Tom Heskes,et al.  Efficiently learning the preferences of people , 2012, Machine Learning.

[3]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[4]  Hovav A. Dror,et al.  Sequential Experimental Designs for Generalized Linear Models , 2008 .

[5]  Haiyan Hou,et al.  BP neural network optimized with PSO algorithm and its application in forecasting , 2006, 2006 IEEE International Conference on Information Acquisition.

[6]  Tao Liu,et al.  Application research on BP artificial neural network and LM algorithms in the fixed assets investment performance evaluation , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[7]  Zhizhong Zhao,et al.  Application and Comparison of BP Neural Network Algorithm in MATLAB , 2010, 2010 International Conference on Measuring Technology and Mechatronics Automation.

[8]  Lin Lin,et al.  An Improved BP Neural Network Model Based on Quasic-Newton Algorithm , 2009, 2009 Fifth International Conference on Natural Computation.

[9]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[10]  Andries Petrus Engelbrecht,et al.  Incremental learning using sensitivity analysis , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[11]  Liang Yan-chun,et al.  The application of GA-BP algorithm to intelligent diagnosis of coronary heart disease , 2010, 2010 International Conference on Computer, Mechatronics, Control and Electronic Engineering.

[12]  Taghi M. Khoshgoftaar,et al.  Active learning with neural networks for intrusion detection , 2010, 2010 IEEE International Conference on Information Reuse & Integration.

[13]  Andries Petrus Engelbrecht.  Selective Learning for Multilayer Feedforward Neural Networks , 2001, IWANN.

[14]  Robert J. Butera,et al.  Sequential Optimal Design of Neurophysiology Experiments , 2009, Neural Computation.

[15]  Peter J. Braspenning,et al.  Artificial Neural Networks: An Introduction to ANN Theory and Practice , 1995, Artificial Neural Networks.

[16]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.