Improving Nearest Neighbor Partitioning Neural Network Classifier Using Multi-layer Particle Swarm Optimization

Nearest neighbor partitioning (NNP) method has been proved to be an effective method to enhance the quality of neural network classifiers. However, there are many cluster shapes in NNP, which results in a large number of local optimal solutions in the searching space by the traditional particle swarm optimization (PSO) algorithm. Therefore, the multi-layer particle swarm optimization (MLPSO) is introduced to increase the diversity of searching groups through increasing the number of layers, thereby improving the performance when facing with large scale problems. In this study, we adopt the combination of multi-layer particle swarm optimization and nearest neighbor partitioning to solve the local optimal problem caused by multi-cluster shapes in the optimization of NNP. Experimental results show that this method improves the performance of classifier.

[1]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Hongwei Sun,et al.  Improvement of neural network classifier using floating centroids , 2011, Knowledge and Information Systems.

[3]  Yuan Zhang,et al.  Fuzzy clustering with the entropy of attribute weights , 2016, Neurocomputing.

[4]  Bo Yang,et al.  Building Image Feature Kinetics for Cement Hydration Using Gene Expression Programming With Similarity Weight Tournament Selection , 2015, IEEE Transactions on Evolutionary Computation.

[5]  Ganapati Panda,et al.  A reduced and comprehensible polynomial neural network for classification , 2008, Pattern Recognit. Lett..

[6]  Engin Avci An expert target recognition system using a genetic wavelet neural network , 2012, Applied Intelligence.

[7]  Susan R. Wilson,et al.  An Efficient Z-Score Algorithm for Assessing Sequence Alignments , 2004, J. Comput. Biol..

[8]  Zhou Weihong,et al.  Optimization of BP Neural Network Classifier Using Genetic Algorithm , 2013 .

[9]  Jeff Orchard,et al.  Particle swarm optimization using dynamic tournament topology , 2016, Appl. Soft Comput..

[10]  Yuehui Chen,et al.  Improving Neural-Network Classifiers Using Nearest Neighbor Partitioning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Xiaohui Yu,et al.  Scalable Distributed Processing of K Nearest Neighbor Queries over Moving Objects , 2015, IEEE Transactions on Knowledge and Data Engineering.

[12]  Chin-Teng Lin,et al.  An Improved Polynomial Neural Network Classifier Using Real-Coded Genetic Algorithm , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Pedro Antonio Gutiérrez,et al.  Neuro-logistic Models Based on Evolutionary Generalized Radial Basis Function for the Microarray Gene Expression Classification Problem , 2011, Neural Processing Letters.

[14]  Bo Yang,et al.  Improving particle swarm optimization using multi-layer searching strategy , 2014, Inf. Sci..

[15]  Zhang Yu-fang Constructing classifier of neural networks using improved genetic algorithms , 2005 .

[16]  Haizhou Li,et al.  A Spiking Neural Network System for Robust Sequence Recognition , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[17]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[18]  Michael P. Wellman,et al.  Bayesian networks , 1995, CACM.

[19]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[20]  I-Cheng Yeh,et al.  Modeling of strength of high-performance concrete using artificial neural networks , 1998 .

[21]  Lin Wang,et al.  Investigating the Evolution of a Neuroplasticity Network for Learning , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.