A Hyper-Solution Framework for SVM Classification: Application for Predicting Destabilizations in Chronic Heart Failure Patients

Support Vector Machines (SVMs) represent a powerful learning paradigm able to provide accurate and reliable decision functions in several application fields. In particular, they are really attractive for application in medical domain, where often a lack of knowledge exists. Kernel trick, on which SVMs are based, allows to map non-linearly separable data into potentially linearly separable one, according to the kernel function and its internal parameters value. During recent years non-parametric approaches have also been proposed for learning the most appropriate kernel, such as linear combination of basic kernels. Thus, SVMs classifiers may have several parameters to be tuned and their optimal values are usually difficult to be identified a-priori. Furthermore, combining different classifiers may reduce risk to perform errors on new unseen data. For such reasons, we present an hyper-solution framework for SVM classification, based on meta-heuristics, that searches for the most reliable hyper-classifier (SVM with a basic kernel, SVM with a combination of kernel, and ensemble of SVMs), and for its optimal configuration. We have applied the proposed framework on a critical and quite complex issue for the management of Chronic Heart Failure patient: the early detection of decompensation conditions. In fact, predicting new destabilizations in advance may reduce the burden of heart failure on the healthcare systems while improving quality of life of affected patients. Promising reliability has been obtained on 10-fold cross validation, proving our approach to be efficient and effective for an high-level analysis of clinical data.

[1]  Sven F. Crone,et al.  Genetic Algorithms for Support Vector Machine Model Selection , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[2]  Nicolas de Condorcet Essai Sur L'Application de L'Analyse a la Probabilite Des Decisions Rendues a la Pluralite Des Voix , 2009 .

[3]  Antonio Candelieri,et al.  Knowledge Discovery Approaches for Early Detection of Decompensation Conditions in Heart Failure Patients , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[4]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[5]  Christophe Charrier,et al.  International Journal of Neural Systems Special Issue on Issue's Topic C World Scientific Publishing Company Tabu Search Model Selection for Svm , 2022 .

[6]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[7]  Seth Stovack Kessler Piezoelectric-based in-situ damage detection of composite materials for structural health monitoring systems , 2002 .

[8]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[9]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[10]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[11]  W. Kannel,et al.  The natural history of congestive heart failure: the Framingham study. , 1971, The New England journal of medicine.

[12]  J. Ornato,et al.  ACC/AHA 2005 Guideline Update for the Diagnosis and Management of Chronic Heart Failure in the Adult—Summary Article , 2005 .

[13]  A. Hoes,et al.  Guidelines for the diagnosis and treatment of chronic heart failure: executive summary (update 2005): The Task Force for the Diagnosis and Treatment of Chronic Heart Failure of the European Society of Cardiology. , 2005, European heart journal.

[14]  Domenico Conforti,et al.  Kernel based support vector machine via semidefinite programming: Application to medical diagnosis , 2010, Comput. Oper. Res..

[15]  John Spertus,et al.  Randomized trial of Telemonitoring to Improve Heart Failure Outcomes (Tele-HF): study design. , 2007, Journal of cardiac failure.

[16]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[17]  Ling-Min He,et al.  Support Vector Machines Ensemble with Optimizing Weights by Genetic Algorithm , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[18]  A. Candelieri,et al.  Early detection of decompensation conditions in heart failure patients by knowledge discovery: The HEARTFAID approaches , 2008, 2008 Computers in Cardiology.

[19]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..