Improving Neural Network Classifier using Gradient-based Floating Centroid Method

Floating centroid method (FCM) offers an efficient way to solve a fixed-centroid problem for the neural network classifiers. However, evolutionary computation as its optimization method restrains the FCM to achieve satisfactory performance for different neural network structures, because of the high computational complexity and inefficiency. Traditional gradient-based methods have been extensively adopted to optimize the neural network classifiers. In this study, a gradient-based floating centroid (GDFC) method is introduced to address the fixed centroid problem for the neural network classifiers optimized by gradient-based methods. Furthermore, a new loss function for optimizing GDFC is introduced. The experimental results display that GDFC obtains promising classification performance than the comparison methods on the benchmark datasets.

[1]  Sarah Jane Delany.  k-Nearest Neighbour Classifiers , 2007 .

[2]  J. Jewaratnam,et al.  Performance comparison of feedforward neural network training algorithms in modeling for synthesis of polycaprolactone via biopolymerization , 2018, Clean Technologies and Environmental Policy.

[3]  Yuehui Chen,et al.  Improving Neural-Network Classifiers Using Nearest Neighbor Partitioning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Bo Yang,et al.  A Novel Improvement of Neural Network Classification Using Further Division of Partition Space , 2007, IWINAC.

[5]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[6]  Hongwei Sun,et al.  Improvement of neural network classifier using floating centroids , 2011, Knowledge and Information Systems.

[7]  A Wibowo,et al.  Optimization of neural network for cancer microRNA biomarkers classification , 2019 .

[8]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[9]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[10]  Lawrence V. Snyder,et al.  Reinforcement Learning for Solving the Vehicle Routing Problem , 2018, NeurIPS.

[11]  Kok Seng Chua,et al.  Efficient computations for large least square support vector machine classifiers , 2003, Pattern Recognit. Lett..

[12]  Hojjat Adeli,et al.  A New Neural Dynamic Classification Algorithm , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Jun Yan,et al.  Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox , 2019, IEEE Transactions on Industrial Electronics.

[14]  A. Kamilaris,et al.  A review of the use of convolutional neural networks in agriculture , 2018, The Journal of Agricultural Science.

[15]  Tong Wang,et al.  A heuristic method for learning Bayesian networks using discrete particle swarm optimization , 2010, Knowledge and Information Systems.