An Optimized Stacked Support Vector Machines Based Expert System for the Effective Prediction of Heart Failure

About half of the people who develop heart failure (HF) die within five years of diagnosis. Over the years, researchers have developed several machine learning-based models for the early prediction of HF and to help cardiologists to improve the diagnosis process. In this paper, we introduce an expert system that stacks two support vector machine (SVM) models for the effective prediction of HF. The first SVM model is linear and $L_{1}$ regularized. It has the capability to eliminate irrelevant features by shrinking their coefficients to zero. The second SVM model is $L_{2}$ regularized. It is used as a predictive model. To optimize the two models, we propose a hybrid grid search algorithm (HGSA) that is capable of optimizing the two models simultaneously. The effectiveness of the proposed method is evaluated using six different evaluation metrics: accuracy, sensitivity, specificity, the Matthews correlation coefficient (MCC), ROC charts, and area under the curve (AUC). The experimental results confirm that the proposed method improves the performance of a conventional SVM model by 3.3%. Moreover, the proposed method shows better performance compared to the ten previously proposed methods that achieved accuracies in the range of 57.85%–91.83%. In addition, the proposed method also shows better performance than the other state-of-the-art machine learning ensemble models.

[1]  Roohallah Alizadehsani,et al.  Diagnosis of Coronary Artery Disease Using Cost-Sensitive Algorithms , 2012, 2012 IEEE 12th International Conference on Data Mining Workshops.

[2]  Visakan Kadirkamanathan,et al.  Statistical Control of RBF-like Networks for Classification , 1997, ICANN.

[3]  Oyebade K. Oyedotun,et al.  Heart Diseases Diagnosis Using Neural Networks Arbitration , 2015 .

[4]  Ji Zhu,et al.  Variable Selection for the Linear Support Vector Machine , 2007, Trends in Neural Computation.

[5]  Padmakumari K. N. Anooj,et al.  Clinical decision support system: risk level prediction of heart disease using weighted fuzzy rules and decision tree rules , 2011, Central European Journal of Computer Science.

[6]  Oguz Findik,et al.  A comparison of feature selection models utilizing binary particle swarm optimization and genetic algorithm in determining coronary artery disease using support vector machine , 2010, Expert Syst. Appl..

[7]  A. V. Senthil Kumar Diagnosis of Heart Disease using Fuzzy Resolution Mechanism , 2012 .

[8]  Harlan M. Krumholz,et al.  Decision Making in Advanced Heart Failure: A Scientific Statement From the American Heart Association , 2012, Circulation.

[9]  Kemal Polat,et al.  Automatic detection of heart disease using an artificial immune recognition system (AIRS) with fuzzy resource allocation mechanism and k , 2007, Expert Syst. Appl..

[10]  Richard Weber,et al.  Feature selection for Support Vector Machines via Mixed Integer Linear Programming , 2014, Inf. Sci..

[11]  Kazuyuki Murase,et al.  Adaptive weighted fuzzy rule-based system for the risk level assessment of heart disease , 2018, Applied Intelligence.

[12]  Abdulkadir Sengür,et al.  Effective diagnosis of heart disease through neural networks ensembles , 2009, Expert Syst. Appl..

[13]  P. K. Anooj,et al.  Clinical decision support system: Risk level prediction of heart disease using weighted fuzzy rules , 2012, J. King Saud Univ. Comput. Inf. Sci..

[14]  Roohallah Alizadehsani,et al.  Computer aided decision making for heart disease detection using hybrid neural network-Genetic algorithm , 2017, Comput. Methods Programs Biomed..

[15]  Paul S. Bradley,et al.  Feature Selection via Concave Minimization and Support Vector Machines , 1998, ICML.

[16]  Jonathan M. Garibaldi,et al.  A hybrid model for automatic identification of risk factors for heart disease , 2015, J. Biomed. Informatics.

[17]  Oluwarotimi Williams Samuel,et al.  An integrated decision support system based on ANN and Fuzzy_AHP for heart failure risk prediction , 2017, Expert Syst. Appl..

[18]  S. Gunes,et al.  A new classification method to diagnosis liver disorders: supervised artificial immune system (AIRS) , 2005, Proceedings of the IEEE 13th Signal Processing and Communications Applications Conference, 2005..

[19]  Gunasekaran Manogaran,et al.  RETRACTED ARTICLE: Hybrid Recommendation System for Heart Disease Diagnosis based on Multiple Kernel Learning with Adaptive Neuro-Fuzzy Inference System , 2017, Multimedia Tools and Applications.

[20]  Omar Adwan,et al.  Automatic Heart Disease Diagnosis System Based on Artificial Neural Network (ANN) and Adaptive Neuro-Fuzzy Inference Systems (ANFIS) Approaches , 2014 .

[21]  Seral Özsen,et al.  Attribute weighting via genetic algorithms for attribute weighted artificial immune system (AWAIS) and its application to heart disease and liver disorders problems , 2009, Expert Syst. Appl..

[22]  Olatunji Mumini Omisore,et al.  A web based decision support system driven by fuzzy logic for the diagnosis of typhoid fever , 2013, Expert Syst. Appl..

[23]  Harun Uguz,et al.  Adaptive neuro-fuzzy inference system for diagnosis of the heart valve diseases using wavelet transform with entropy , 2011, Neural Computing and Applications.