A Novel Neural Network Classifier Using Beetle Antennae Search Algorithm for Pattern Classification

Traditional training algorithms in artificial neural networks (ANNs) show some inherent weaknesses, such as the possibility of falling into local optimum, slow learning speed, and the inability to determine the optimal neuronal structure. To remedy the deficiencies of traditional neural networks, this paper proposes a novel neural network classifier (NNC) using the beetle antennae search (BAS) algorithm, termed BASNNC. The BAS algorithm is explored to optimize the weights of the NNC. The network of the proposed BASNNC adopts three-layer structure, including an input layer, a hidden layer, and an output layer. Quite differing from the traditional training algorithm using a principle of gradient descent, the weights between the hidden and output layers are optimized by the BAS algorithm, which effectively improves the computational speed of the classifier. The numerical studies, applications to pattern classification and comparisons with an error back-propagation neural network model, show that the proposed BASNNC has faster computational speed and higher classification accuracy.

[1]  Jun Wang,et al.  A Complex-Valued Projection Neural Network for Constrained Optimization of Real Functions in Complex Variables , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Jun Sun,et al.  Building Fast and Compact Convolutional Neural Networks for Offline Handwritten Chinese Character Recognition , 2017, Pattern Recognit..

[3]  Xiaoming Liu,et al.  Mass Classification in Mammograms Using Selected Geometry and Texture Features, and a New SVM-Based Feature Selection Method , 2014, IEEE Systems Journal.

[4]  Isaac Chairez,et al.  Adaptive Identifier for Uncertain Complex Nonlinear Systems Based on Continuous Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Shengxiang Yang,et al.  Training neural networks with ant colony optimization algorithms for pattern classification , 2015, Soft Comput..

[6]  Dongsheng Guo,et al.  Cross-validation based weights and structure determination of Chebyshev-polynomial neural networks for pattern classification , 2014, Pattern Recognit..

[7]  Brian Kingsbury,et al.  New types of deep neural network learning for speech recognition and related applications: an overview , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  George W. Irwin,et al.  Two-Stage Orthogonal Least Squares Methods for Neural Network Construction , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Maoguo Gong,et al.  A Multiobjective Sparse Feature Learning Model for Deep Neural Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Jingyu Wang,et al.  Multi-Context Integrated Deep Neural Network Model for Next Location Prediction , 2018, IEEE Access.

[11]  Reddi Kamesh,et al.  Novel Formulation of Adaptive MPC as EKF Using ANN Model: Multiproduct Semibatch Polymerization Reactor Case Study , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Chang Huang,et al.  Super-resolution mapping of wetland inundation from remote sensing imagery based on integration of back-propagation neural network and genetic algorithm , 2015 .

[13]  Ge Xiurun,et al.  An improved PSO-based ANN with simulated annealing technique , 2005, Neurocomputing.

[14]  Feng Yu,et al.  A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network , 2014 .

[15]  Chao Li,et al.  A Convolutional Neural Network Model for Online Medical Guidance , 2016, IEEE Access.

[16]  Wei Lu,et al.  An Adaptive-PSO-Based Self-Organizing RBF Neural Network , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Shuai Li,et al.  Zeroing neural-dynamics approach and its robust and rapid solution for parallel robot manipulators against superposition of multiple disturbances , 2018, Neurocomputing.

[18]  Tao Chen,et al.  Back propagation neural network with adaptive differential evolution algorithm for time series forecasting , 2015, Expert Syst. Appl..

[19]  T. F. Burks,et al.  Evaluation of Neural-network Classifiers for Weed Species Discrimination , 2005 .

[20]  Xin Yao,et al.  A hybrid Hopfield network-genetic algorithm approach for the terminal assignment problem , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  George C. Runger,et al.  GCRNN: Group-Constrained Convolutional Recurrent Neural Network , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Ying Wang,et al.  On exponential convergence of nonlinear gradient dynamics system with application to square root finding , 2015 .

[23]  Shuai Li,et al.  Zeroing Neural Dynamics for Control Design: Comprehensive Analysis on Stability, Robustness, and Convergence Speed , 2019, IEEE Transactions on Industrial Informatics.

[24]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[25]  Chee Peng Lim,et al.  An Enhanced Fuzzy Min–Max Neural Network for Pattern Classification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Shukai Duan,et al.  Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Jie Duan,et al.  Research on Agricultural Machinery Fault Diagnosis System Based on Expert System , 2018, 2018 2nd IEEE Advanced Information Management,Communicates,Electronic and Automation Control Conference (IMCEC).

[28]  Zhijun Zhang,et al.  Weights and structure determination of multiple-input feed-forward neural network activated by Chebyshev polynomials of Class 2 via cross-validation , 2014, Neural Computing and Applications.

[29]  Chao Ren,et al.  Optimal parameters selection for BP neural network based on particle swarm optimization: A case study of wind speed forecasting , 2014, Knowl. Based Syst..

[30]  Shaocheng Tong,et al.  Adaptive Neural Network Control for Active Suspension Systems With Time-Varying Vertical Displacement and Speed Constraints , 2019, IEEE Transactions on Industrial Electronics.

[31]  Zhongsheng Hou,et al.  Data-Driven Modeling for UGI Gasification Processes via an Enhanced Genetic BP Neural Network With Link Switches , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Shuai Li,et al.  Intelligent Beetle Antennae Search for UAV Sensing and Avoidance of Obstacles , 2019, Sensors.

[34]  David R. Karger,et al.  Tackling the Poor Assumptions of Naive Bayes Text Classifiers , 2003, ICML.

[35]  Bin Xu,et al.  Convergence analysis of beetle antennae search algorithm and its applications , 2019, Soft Computing.

[36]  Yunong Zhang,et al.  Weights Direct Determination of Feedforward Neural Networks without Iterative BP-Training , 2010 .

[37]  Shuai Li,et al.  Tracking Control of Robot Manipulators with Unknown Models: A Jacobian-Matrix-Adaption Method , 2018, IEEE Transactions on Industrial Informatics.

[38]  Shifei Ding,et al.  An optimizing BP neural network algorithm based on genetic algorithm , 2011, Artificial Intelligence Review.

[39]  Yi Lu Murphey,et al.  Multi-class pattern classification using neural networks , 2007, Pattern Recognit..

[40]  Kaiyun Fu,et al.  The genetic algorithm based back propagation neural network for MMP prediction in CO2-EOR process , 2014 .

[41]  Shuai Li,et al.  A Novel Recurrent Neural Network for Manipulator Control With Improved Noise Tolerance , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Shuai Li,et al.  Rejecting Chaotic Disturbances Using a Super-Exponential-Zeroing Neurodynamic Approach for Synchronization of Chaotic Sensor Systems , 2018, Sensors.

[43]  Huaguang Zhang,et al.  Neural-Network-Based Robust Optimal Tracking Control for MIMO Discrete-Time Systems With Unknown Uncertainty Using Adaptive Critic Design , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Huibing Zhao,et al.  Fault detection and diagnosis for railway switching points using fuzzy neural network , 2015, 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA).

[45]  Jiliang Zhang,et al.  On Modified Multi-Output Chebyshev-Polynomial Feed-Forward Neural Network for Pattern Classification of Wine Regions , 2019, IEEE Access.

[46]  Ying Wang,et al.  Twice-Pruning Aided WASD Neuronet of Bernoulli-Polynomial Type with Extension to Robust Classification , 2013, 2013 IEEE 11th International Conference on Dependable, Autonomic and Secure Computing.

[47]  Yunong Zhang,et al.  Weights and structure determination (WASD) of multiple-input hermit orthogonal polynomials neural network (MIHOPNN) , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).

[48]  Shuai Li,et al.  BAS: Beetle Antennae Search Algorithm for Optimization Problems , 2017, ArXiv.

[49]  Qibing Jin,et al.  Decoupled ARX and RBF Neural Network Modeling Using PCA and GA Optimization for Nonlinear Distributed Parameter Systems , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[50]  Ying Wang,et al.  WASD Algorithm with Pruning-While-Growing and Twice-Pruning Techniques for Multi-Input Euler Polynomial Neural Network , 2016, Int. J. Artif. Intell. Tools.

[51]  Yunong Zhang,et al.  Robust Zeroing Neural-Dynamics and Its Time-Varying Disturbances Suppression Model Applied to Mobile Robot Manipulators , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[52]  Yunong Zhang,et al.  A Hybrid Multi-Objective Scheme Applied to Redundant Robot Manipulators , 2017, IEEE Transactions on Automation Science and Engineering.

[53]  Lixin Fan.  Accurate Robust and Efficient Error Estimation for Decision Trees , 2016, ICML.

[54]  Madhuri A. Chaudhari,et al.  Conjugate gradient back-propagation based artificial neural network for real time power quality assessment , 2016 .

[55]  Steve B. Furber,et al.  Deep Spiking Neural Network model for time-variant signals classification: a real-time speech recognition approach , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).