Grey wolf optimization evolving kernel extreme learning machine: Application to bankruptcy prediction

Abstract This study proposes a new kernel extreme learning machine (KELM) parameter tuning strategy using a novel swarm intelligence algorithm called grey wolf optimization (GWO). GWO, which simulates the social hierarchy and hunting behavior of grey wolves in nature, is adopted to construct an effective KELM model for bankruptcy prediction. The derived model GWO-KELM is rigorously compared with three competitive KELM methods, which are typical in a comprehensive set of methods including particle swarm optimization-based KELM, genetic algorithm-based KELM, grid-search technique-based KELM, extreme learning machine, improved extreme learning machine, support vector machines and random forest, on two real-life datasets via 10-fold cross validation analysis. Results obtained clearly confirm the superiority of the developed model in terms of classification accuracy (training, validation, test), Type I error, Type II error, area under the receiver operating characteristic curve (AUC) criterion as well as computational time. Therefore, the proposed GWO-KELM prediction model is promising to serve as a powerful early warning tool with excellent performance for bankruptcy prediction.

[1]  Vadlamani Ravi,et al.  Bacterial foraging trained wavelet neural networks: application to bankruptcy prediction in banks , 2011, Int. J. Data Anal. Tech. Strateg..

[2]  Prakash P. Shenoy,et al.  Using Bayesian networks for bankruptcy prediction: Some methodological issues , 2007, Eur. J. Oper. Res..

[3]  Vadlamani Ravi,et al.  Bankruptcy Prediction in Banks by Principal Component Analysis Threshold Accepting trained Wavelet Neural Network Hybrid , 2022 .

[4]  Zhiping Lin,et al.  Self-Adaptive Evolutionary Extreme Learning Machine , 2012, Neural Processing Letters.

[5]  Sumit Sarkar,et al.  Bayesian Models for Early Warning of Bank Failures , 2001, Manag. Sci..

[6]  Elena Fedorova,et al.  Bankruptcy prediction for Russian companies: Application of combined classifiers , 2013, Expert Syst. Appl..

[7]  Chunyan Miao,et al.  Comparing the learning effectiveness of BP, ELM, I-ELM, and SVM for corporate credit ratings , 2014, Neurocomputing.

[8]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Vadlamani Ravi,et al.  An ant colony optimisation and Nelder-Mead simplex hybrid algorithm for training neural networks: an application to bankruptcy prediction in banks , 2013, Int. J. Inf. Decis. Sci..

[10]  W. Beaver.  Financial Ratios As Predictors Of Failure , 1966 .

[11]  Amaury Lendasse,et al.  Bankruptcy prediction using Extreme Learning Machine and financial expertise , 2014, Neurocomputing.

[12]  Liwei Tang,et al.  2-D defect profile reconstruction from ultrasonic guided wave signals based on QGA-kernelized ELM , 2014, Neurocomputing.

[13]  Joaquín Abellán,et al.  Improving experimental studies about ensembles of classifiers for bankruptcy prediction and credit scoring , 2014, Expert Syst. Appl..

[14]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[15]  Dayou Liu,et al.  Evolving support vector machines using fruit fly optimization for medical data classification , 2016, Knowl. Based Syst..

[16]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[17]  R. C. West.  A factor-analytic approach to bank condition , 1985 .

[18]  Guang-Bin Huang,et al.  Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions , 1998, IEEE Trans. Neural Networks.

[19]  Seyed Mohammad Mirjalili.  How effective is the Grey Wolf optimizer in training multi-layer perceptrons , 2014, Applied Intelligence.

[20]  Jianzhong Wang,et al.  Excavation Equipment Recognition Based on Novel Acoustic Statistical Features , 2017, IEEE Transactions on Cybernetics.

[21]  Peter L. Bartlett,et al.  The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network , 1998, IEEE Trans. Inf. Theory.

[22]  Chen Chen,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine , 2014, Remote. Sens..

[23]  Vadlamani Ravi,et al.  Failure prediction of banks using threshold accepting trained kernel principal component neural network , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[24]  Wan-Yu Deng,et al.  Cross-person activity recognition using reduced kernel extreme learning machine , 2014, Neural Networks.

[25]  Vadlamani Ravi,et al.  Differential evolution trained wavelet neural networks: Application to bankruptcy prediction in banks , 2009, Expert Syst. Appl..

[26]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[27]  Steven Salzberg,et al.  On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach , 1997, Data Mining and Knowledge Discovery.

[28]  Mohd Herwan Sulaiman,et al.  Using the gray wolf optimizer for solving optimal reactive power dispatch problem , 2015, Appl. Soft Comput..

[29]  Jinsha Yuan.  Fault Diagnosis of Power Transformers using Kernel based Extreme Learning Machine with Particle Swarm Optimization , 2015 .

[30]  W. Pietruszkiewicz,et al.  Dynamical systems and nonlinear Kalman filtering applied in classification , 2008, 2008 7th IEEE International Conference on Cybernetic Intelligent Systems.

[31]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[32]  Korris Fu-Lai Chung,et al.  Positive and negative fuzzy rule system, extreme learning machine and image classification , 2011, Int. J. Mach. Learn. Cybern..

[33]  P. Saratchandran,et al.  Multicategory Classification Using An Extreme Learning Machine for Microarray Gene Expression Cancer Diagnosis , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[34]  Young-Chan Lee,et al.  Bankruptcy prediction using support vector machine with optimal choice of kernel function parameters , 2005, Expert Syst. Appl..

[35]  Sin-Jin Lin,et al.  Multiple extreme learning machines for a two-class imbalance corporate life cycle prediction , 2013, Knowl. Based Syst..

[36]  Chih-Fong Tsai,et al.  Using neural network ensembles for bankruptcy prediction and credit scoring , 2008, Expert Syst. Appl..

[37]  C. Raghavendra Rao,et al.  Differential evolution trained radial basis function network: application to bankruptcy prediction in banks , 2010, Int. J. Bio Inspired Comput..

[38]  Yu Jiang,et al.  An effective diagnosis method for single and multiple defects detection in gearbox based on nonlinear feature selection and kernel-based extreme learning machine , 2014 .

[39]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[40]  Gang Wang,et al.  An efficient hybrid kernel extreme learning machine approach for early diagnosis of Parkinson's disease , 2016, Neurocomputing.

[41]  Vadlamani Ravi,et al.  Differential evolution trained kernel principal component WNN and kernel binary quantile regression: Application to banking , 2013, Knowl. Based Syst..

[42]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[43]  Vadlamani Ravi,et al.  Threshold accepting trained principal component neural network and feature subset selection: Application to bankruptcy prediction in banks , 2008, Appl. Soft Comput..

[44]  Allan Pinkus,et al.  Multilayer Feedforward Networks with a Non-Polynomial Activation Function Can Approximate Any Function , 1991, Neural Networks.

[45]  Huiling Chen,et al.  An Effective Computational Model for Bankruptcy Prediction Using Kernel Extreme Learning Machine Approach , 2017 .

[46]  Gang Wang,et al.  An Adaptive Fuzzy k-Nearest Neighbor Method Based on Parallel Particle Swarm Optimization for Bankruptcy Prediction , 2011, PAKDD.

[47]  Tuo Zhao,et al.  An enhance excavation equipments classification algorithm based on acoustic spectrum dynamic feature , 2017, Multidimens. Syst. Signal Process..

[48]  Jihong Ouyang,et al.  A novel kernel extreme learning machine algorithm based on self-adaptive artificial bee colony optimisation strategy , 2016, Int. J. Syst. Sci..

[49]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[50]  Huiling Chen,et al.  Using Blood Indexes to Predict Overweight Statuses: An Extreme Learning Machine-Based Approach , 2015, PloS one.

[51]  James A. Ohlson.  FINANCIAL RATIOS AND THE PROBABILISTIC PREDICTION OF BANKRUPTCY , 1980 .

[52]  Kyung-shik Shin,et al.  An application of support vector machines in bankruptcy prediction model , 2005, Expert Syst. Appl..

[53]  G. M. Komaki,et al.  Grey Wolf Optimizer algorithm for the two-stage assembly flow shop scheduling problem with release time , 2015, J. Comput. Sci..

[54]  U. Dellepiane,et al.  Bankruptcy Prediction Using Support Vector Machines and Feature Selection During the Recent Financial Crisis , 2015 .

[55]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[56]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[57]  Kai Zhang,et al.  Extreme learning machine and adaptive sparse representation for image classification , 2016, Neural Networks.

[58]  Sirapat Chiewchanwattana,et al.  An improved grey wolf optimizer for training q-Gaussian Radial Basis Functional-link nets , 2014, 2014 International Computer Science and Engineering Conference (ICSEC).

[59]  Edward I. Altman,et al.  FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY , 1968 .

[60]  Amir F. Atiya,et al.  Bankruptcy prediction for credit risk using neural networks: A survey and new results , 2001, IEEE Trans. Neural Networks.

[61]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[62]  Stevica S. Cvetkovi,et al.  Kernel based Extreme Learning Machines for Image Classification , 2016 .

[63]  Vadlamani Ravi,et al.  Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review , 2007, Eur. J. Oper. Res..

[64]  Gang Wang,et al.  A novel bankruptcy prediction model based on an adaptive fuzzy k-nearest neighbor method , 2011, Knowl. Based Syst..