Toward an optimal kernel extreme learning machine using a chaotic moth-flame optimization strategy with applications in medical diagnoses

Abstract This study proposes a novel learning scheme for the kernel extreme learning machine ( KELM ) based on the chaotic moth-flame optimization ( CMFO ) strategy. In the proposed scheme, CMFO simultaneously performs parameter optimization and feature selection. The proposed methodology is rigorously compared to several other competitive KELM models that are based on the original moth-flame optimization, particle swarm optimization, and genetic algorithms. The comparison is made using the medical diagnosis problems of Parkinson's disease and breast cancer. And the proposed method has successfully been applied to practical medical diagnosis cases. The experimental results demonstrate that, compared to the alternative methods, the proposed method offers significantly better classification performance and also obtains a smaller feature subset. Promisingly, the proposed CMFOFS - KELM , can serve as an effective and efficient computer aided tool for medical diagnosis in the field of medical decision making.

[1]  Xue-cun Yang,et al.  Pressure Prediction of Coal Slurry Transportation Pipeline Based on Particle Swarm Optimization Kernel Function Extreme Learning Machine , 2015 .

[2]  Yongquan Zhou,et al.  Lévy-Flight Moth-Flame Algorithm for Function Optimization and Engineering Design Problems , 2016 .

[3]  Chengqi Zhang,et al.  A Model Using Texture Features to Differentiate the Nature of Thyroid Nodules on Sonography , 2015, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[4]  Amaury Lendasse,et al.  Extreme learning machines for soybean classification in remote sensing hyperspectral images , 2014, Neurocomputing.

[5]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Liwei Tang,et al.  2-D defect profile reconstruction from ultrasonic guided wave signals based on QGA-kernelized ELM , 2014, Neurocomputing.

[7]  Songlin Sun,et al.  Fault diagnosis of sensor by chaos particle swarm optimization algorithm and support vector machine , 2011, Expert systems with applications.

[8]  Wei-Chang Yeh,et al.  Knowledge Discovery Employing Grid Scheme Least Squares Support Vector Machines Based on Orthogonal Design Bee Colony Algorithm , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Antonino Staiano,et al.  Investigation of Single Nucleotide Polymorphisms Associated to Familial Combined Hyperlipidemia with Random Forests , 2012, WIRN.

[10]  W. Koller,et al.  An algorithm (decision tree) for the management of Parkinson’s disease (2001): , 1998, Neurology.

[11]  M. Ringnér,et al.  Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks , 2001, Nature Medicine.

[12]  Jianzhong Wang,et al.  Excavation Equipment Recognition Based on Novel Acoustic Statistical Features , 2017, IEEE Transactions on Cybernetics.

[13]  Tze-Yun Leong,et al.  Application of K-nearest neighbors algorithm on breast cancer diagnosis problem , 2000, AMIA.

[14]  Huiling Chen,et al.  An Effective Computational Model for Bankruptcy Prediction Using Kernel Extreme Learning Machine Approach , 2017 .

[15]  Wan-Yu Deng,et al.  Cross-person activity recognition using reduced kernel extreme learning machine , 2014, Neural Networks.

[16]  Cheng-Yan Kao,et al.  Applying the genetic approach to simulated annealing in solving some NP-hard problems , 1993, IEEE Trans. Syst. Man Cybern..

[17]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[18]  Aboul Ella Hassanien,et al.  Bio-inspired Swarm Techniques for Thermogram Breast Cancer Detection , 2016 .

[19]  Qiang Li,et al.  An Enhanced Grey Wolf Optimization Based Feature Selection Wrapped Kernel Extreme Learning Machine for Medical Diagnosis , 2017, Comput. Math. Methods Medicine.

[20]  Dalia Yousri,et al.  Parameters extraction of the three diode model for the multi-crystalline solar cell/module using Moth-Flame Optimization Algorithm , 2016 .

[21]  Gang Wang,et al.  A novel bankruptcy prediction model based on an adaptive fuzzy k-nearest neighbor method , 2011, Knowl. Based Syst..

[22]  Hossam M. Zawbaa,et al.  Impact of Chaos Functions on Modern Swarm Optimizers , 2016, PloS one.

[23]  Jihong Ouyang,et al.  An Efficient Diagnosis System for Parkinson's Disease Using Kernel-Based Extreme Learning Machine with Subtractive Clustering Features Weighting Approach , 2014, Comput. Math. Methods Medicine.

[24]  R. Venkatesh Babu,et al.  No-reference image quality assessment using modified extreme learning machine classifier , 2009, Appl. Soft Comput..

[25]  Yu Jiang,et al.  An effective diagnosis method for single and multiple defects detection in gearbox based on nonlinear feature selection and kernel-based extreme learning machine , 2014 .

[26]  Mahesh Pal.  Extreme‐learning‐machine‐based land cover classification , 2008, ArXiv.

[27]  Gang Wang,et al.  An efficient hybrid kernel extreme learning machine approach for early diagnosis of Parkinson's disease , 2016, Neurocomputing.

[28]  W. Art Chaovalitwongse,et al.  Optimization Models for Feature Selection of Decomposed Nearest Neighbor , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[29]  H. Minuchehr,et al.  Loading pattern optimization of PWR reactors using Artificial Bee Colony , 2011 .

[30]  Kamlesh Mistry,et al.  Intelligent facial emotion recognition using moth-firefly optimization , 2016, Knowl. Based Syst..

[31]  Dayou Liu,et al.  Evolving support vector machines using fruit fly optimization for medical data classification , 2016, Knowl. Based Syst..

[32]  Chen Chen,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine , 2014, Remote. Sens..

[33]  Q. M. Jonathan Wu,et al.  Human face recognition based on multidimensional PCA and extreme learning machine , 2011, Pattern Recognit..

[34]  Xuehua Zhao,et al.  An Efficient and Effective Automatic Recognition System for Online Recognition of Foreign Fibers in Cotton , 2016, IEEE Access.

[35]  Qiang Huang,et al.  Chaos and Bifurcation Control of Torque-Stiffness-Controlled Dynamic Bipedal Walking , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[36]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[37]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Gang Wang,et al.  Towards an optimal support vector machine classifier using a parallel particle swarm optimization strategy , 2014, Appl. Math. Comput..

[39]  Andrew Lewis,et al.  Biogeography-based optimisation with chaos , 2014, Neural Computing and Applications.

[40]  Cunbin Li,et al.  A least squares support vector machine model optimized by moth-flame optimization algorithm for annual power load forecasting , 2016, Applied Intelligence.

[41]  Shahryar Rahnamayan,et al.  A novel population initialization method for accelerating evolutionary algorithms , 2007, Comput. Math. Appl..

[42]  P. Saratchandran,et al.  Multicategory Classification Using An Extreme Learning Machine for Microarray Gene Expression Cancer Diagnosis , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[43]  Leandro dos Santos Coelho,et al.  Use of chaotic sequences in a biologically inspired algorithm for engineering design optimization , 2008, Expert Syst. Appl..

[44]  Tong Liu,et al.  A fast approach for detection of erythemato-squamous diseases based on extreme learning machine with maximum relevance minimum redundancy feature selection , 2015, Int. J. Syst. Sci..

[45]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[46]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[47]  Huiling Chen,et al.  Using Blood Indexes to Predict Overweight Statuses: An Extreme Learning Machine-Based Approach , 2015, PloS one.

[48]  Xinman Zhang,et al.  Video analysis using spatiotemporal descriptor and kernel extreme learning machine for lip reading , 2015, J. Electronic Imaging.

[49]  Lufeng Hu,et al.  An efficient machine learning approach for diagnosis of paraquat-poisoned patients , 2015, Comput. Biol. Medicine.

[50]  Kai Zhang,et al.  Extreme learning machine and adaptive sparse representation for image classification , 2016, Neural Networks.