A compact fuzzy rule interpretation of SVM classifier for medical whole slide images

In this paper, we address the lack of interpretability of Support Vector Machine (SVM) via rules based on support vectors. The lack of intuitive explanation of the rules in the domain of medical whole slide image classification by determining a reduced subset of Scale-Invariant Feature Transform (SIFT) features and linear dimensionality reduction. This reduced subset of SIFT features that participate in decision making provide an intuitive interpretation of the decision rules via a visual presentation of the features in a slide image. In our work, we have taken whole-slide images of sentinel lymph node to predict the presence of cancer using SVM and developed an equivalent Fuzzy model for better interpretability. The SVM model consisted of 50 support vectors which achieved an accuracy of 94.59%. A two IF-THEN rules equivalent Fuzzy Rule Based Model (FRBS) was created using all 50 support vectors which classified each WSI in either {−1, 1} class for non-cancerous and cancerous respectively. FRBS achieved 91.89% accuracy which shows that it is able to represent SVM working accurately in a human interpretable way.

[1]  Juan Luis Castro,et al.  Extraction of fuzzy rules from support vector machines , 2007, Fuzzy Sets Syst..

[2]  Yi Pan,et al.  Rule generation for protein secondary structure prediction with support vector machines and decision tree , 2006, IEEE Transactions on NanoBioscience.

[3]  Nuno Vasconcelos,et al.  Direct convex relaxations of sparse SVM , 2007, ICML '07.

[4]  Bart Baesens,et al.  Rule Extraction from Support Vector Machines: An Overview of Issues and Application in Credit Scoring , 2008, Rule Extraction from Support Vector Machines.

[5]  Jie Wang,et al.  Extraction of Fuzzy Rules by Using Support Vector Machines , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[6]  Andrew P. Bradley,et al.  Rule extraction from support vector machines: A review , 2010, Neurocomputing.

[7]  Andrew P. Bradley,et al.  Rule Extraction from Support Vector Machines: A Sequential Covering Approach , 2007, IEEE Transactions on Knowledge and Data Engineering.

[8]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[9]  Huiqing Liu,et al.  Use of Built-in Features in the Interpretation of High-dimensional Cancer Diagnosis Data , 2004, APBC.

[10]  Kok Wai Wong,et al.  Rule extraction from electroencephalogram signals using support vector machine , 2017, 2017 9th International Conference on Knowledge and Smart Technology (KST).

[11]  Joachim Diederich,et al.  Learning-Based Rule-Extraction From Support Vector Machines: Performance On Benchmark Data Sets , 2004 .

[12]  Duc-Hien Nguyen,et al.  Improving the Interpretability of Support Vector Machines-based Fuzzy Rules , 2014, ArXiv.

[13]  Ivan Bratko,et al.  Nomograms for visualizing support vector machines , 2005, KDD '05.