A Novel Hybrid Model Based on TVIW-PSO-GSA Algorithm and Support Vector Machine for Classification Problems

The increasingly serious haze problem in China has brought about a growing public awareness of air quality. Precise air quality index (AQI) forecasts play an important role in both controlling air pollution and promoting the sustainable development of human society. However, the randomness, non-stationarity, and irregularity of the AQI series make its classifications very difficult. This paper introduces a time-varying inertia weighting (TVIW) strategy based on a combination of gravitation search algorithm (GSA) and particle swarm optimization (PSO) called the TVIW-PSO-GSA. The TVIW-PSO-GSA is utilized to optimize the penalty parameter <inline-formula> <tex-math notation="LaTeX">$C$ </tex-math></inline-formula> and kernel function parameter <inline-formula> <tex-math notation="LaTeX">$\gamma $ </tex-math></inline-formula> of a support vector machine (SVM) to create a hybrid TVIW-PSO-GSA-SVM algorithm. Twenty-three benchmark functions, five UCI datasets, and an AQI hierarchical classification example are tested to find that the convergence speed and performance of the TVI-PSO-GSA exceed those of other algorithms, and the TVIW-PSO-GSA-SVM algorithm also achieves higher classification accuracy and efficiency than the PSO-GSA-SVM, GSA-SVM, GA-SVM, or PSO-SVM, which indicates that the TVIW-PSO-GSA-SVM reliably and accurately classifies AQI and UCI datasets.

[1]  Xiaomin Xie Improvement on projection twin support vector machine , 2017, Neural Computing and Applications.

[2]  Sam Kwong,et al.  Genetic algorithms and their applications , 1996, IEEE Signal Process. Mag..

[3]  Hae-Chang Rim,et al.  Some Effective Techniques for Naive Bayes Text Classification , 2006, IEEE Transactions on Knowledge and Data Engineering.

[4]  Jingjing Tang,et al.  Multiview Privileged Support Vector Machines , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Hossein Nezamabadi-pour,et al.  Filter modeling using gravitational search algorithm , 2011, Eng. Appl. Artif. Intell..

[6]  Serhat Duman,et al.  Optimal power flow using gravitational search algorithm , 2012 .

[7]  Yong Liu,et al.  A new parameter optimization algorithm of SVM , 2011 .

[8]  Josef Kittler,et al.  Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jianzhong Zhou,et al.  Semi-supervised weighted kernel clustering based on gravitational search for fault diagnosis. , 2014, ISA transactions.

[10]  Ying-Li Chen,et al.  Prediction of apoptosis protein subcellular location using improved hybrid approach and pseudo-amino acid composition. , 2007, Journal of theoretical biology.

[11]  Benyuan Liu,et al.  Using LIBS to diagnose melanoma in biomedical fluids deposited on solid substrates: Limits of direct spectral analysis and capability of machine learning , 2018, Spectrochimica Acta Part B: Atomic Spectroscopy.

[12]  Hossein Nezamabadi-pour,et al.  Disruption: A new operator in gravitational search algorithm , 2011, Sci. Iran..

[13]  Yi Yang,et al.  Big Data Meet Cyber-Physical Systems: A Panoramic Survey , 2018, IEEE Access.

[14]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[15]  Hung-Hsu Tsai,et al.  Facial expression recognition using a combination of multiple facial features and support vector machine , 2018, Soft Comput..

[16]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[17]  Cheng-Lung Huang,et al.  A distributed PSO-SVM hybrid system with feature selection and parameter optimization , 2008, Appl. Soft Comput..

[18]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[19]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[21]  Ping Chen,et al.  An improved gravitational search algorithm for green partner selection in virtual enterprises , 2016, Neurocomputing.

[22]  Hossein Nezamabadi-pour,et al.  Facing the classification of binary problems with a GSA-SVM hybrid system , 2013, Math. Comput. Model..

[23]  Marie-Françoise Lucas,et al.  Multi-channel surface EMG classification using support vector machines and signal-based wavelet optimization , 2008, Biomed. Signal Process. Control..

[24]  Brigitte Chebel-Morello,et al.  Application of empirical mode decomposition and artificial neural network for automatic bearing fault diagnosis based on vibration signals , 2015 .

[25]  L. Duponchel,et al.  Support vector machines (SVM) in near infrared (NIR) spectroscopy: Focus on parameters optimization and model interpretation , 2009 .

[26]  Song Guo,et al.  Information and Communications Technologies for Sustainable Development Goals: State-of-the-Art, Needs and Perspectives , 2018, IEEE Communications Surveys & Tutorials.

[27]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[28]  Vishal Kumar,et al.  Genetic algorithm based support vector machine for on-line voltage stability monitoring , 2015 .

[29]  Ouahab Kadri,et al.  Fault diagnosis of rotary kiln using SVM and binary ACO , 2012 .

[30]  Guozhong Feng,et al.  A probabilistic model derived term weighting scheme for text classification , 2018, Pattern Recognit. Lett..

[31]  P. J. García Nieto,et al.  A hybrid PSO optimized SVM-based model for predicting a successful growth cycle of the Spirulina platensis from raceway experiments data , 2016, J. Comput. Appl. Math..

[32]  Konstantinos G. Margaritis,et al.  On benchmarking functions for genetic algorithms , 2001, Int. J. Comput. Math..

[33]  Xiaoqi Ma,et al.  Construction of Pancreatic Cancer Classifier Based on SVM Optimized by Improved FOA , 2015, BioMed research international.

[34]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[35]  Song Guo,et al.  Big Data Meet Green Challenges: Big Data Toward Green Applications , 2016, IEEE Systems Journal.

[36]  Sakti Prasad Ghoshal,et al.  A novel opposition-based gravitational search algorithm for combined economic and emission dispatch problems of power systems , 2012 .

[37]  Ponnuthurai N. Suganthan,et al.  Structural pattern recognition using genetic algorithms with specialized operators , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[38]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Goutam Sanyal,et al.  Multiple Hidden Markov Model Post Processed with Support Vector Machine to Recognize English Handwritten Numerals , 2018, Int. J. Artif. Intell. Tools.

[40]  Jianzhong Zhou,et al.  Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm , 2011 .

[41]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[42]  Yi-Leh Wu,et al.  Fundamental Matrix Estimation using Evolutionary Algorithms with Multi-Objective Functions , 2008, J. Inf. Sci. Eng..

[43]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[44]  Song Guo,et al.  Big Data Meet Green Challenges: Greening Big Data , 2016, IEEE Systems Journal.

[45]  Shifei Ding,et al.  Twin support vector machines based on fruit fly optimization algorithm , 2016, Int. J. Mach. Learn. Cybern..

[46]  Mingbao Li,et al.  Measurement of lumber moisture content based on PCA and GS-SVM , 2018, Journal of Forestry Research.

[47]  Mingtian Zhou,et al.  Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes , 2011, Expert Syst. Appl..

[48]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[49]  P. Karthigaikumar,et al.  ECG Signal Preprocessing and SVM Classifier-Based Abnormality Detection in Remote Healthcare Applications , 2018, IEEE Access.

[50]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[51]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[52]  Seyed-Hamid Zahiri,et al.  Decision function estimation using intelligent gravitational search algorithm , 2012, Int. J. Mach. Learn. Cybern..

[53]  Jason Gu,et al.  Solution of an Economic Dispatch Problem Through Particle Swarm Optimization: A Detailed Survey – Part II , 2017, IEEE Access.

[54]  Goutam Sanyal,et al.  Novel features and a cascaded classifier based Arabic numerals recognition system , 2018, Multidimens. Syst. Signal Process..

[55]  Xiangtao Li,et al.  A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering , 2011, Expert Syst. Appl..

[56]  Jian-Hui Jiang,et al.  Radial Basis Function Network-Based Transform for a Nonlinear Support Vector Machine as Optimized by a Particle Swarm Optimization Algorithm with Application to QSAR Studies , 2007, J. Chem. Inf. Model..

[57]  Li Yang,et al.  CFD simulation research on residential indoor air quality. , 2014, The Science of the total environment.

[58]  李翔,et al.  A new support vector machine optimized by improved particle swarm optimization and its application , 2006 .

[59]  Wang Shi-tong Enhanced version of gravitational search algorithm:weighted GSA , 2011 .

[60]  Yu Huang,et al.  Review on landslide susceptibility mapping using support vector machines , 2018, CATENA.

[61]  Weiping Zhang,et al.  Forecasting of turbine heat rate with online least squares support vector machine based on gravitational search algorithm , 2013, Knowl. Based Syst..

[62]  Andrius Usinskas,et al.  A SURVEY OF GENETIC ALGORITHMS APPLICATIONS FOR IMAGE ENHANCEMENT AND SEGMENTATION , 2007 .