A new classifier fusion method based on confusion matrix and classification confidence for recognizing common CT imaging signs of lung diseases

Common CT Imaging Signs of Lung Diseases (CISL) are defined as the imaging signs that frequently appear in lung CT images from patients and play important roles in the diagnosis of lung diseases. This paper proposes a new method of multiple classifier fusion to recognize the CISLs, which is based on the confusion matrices of the classifiers and the classification confidence values outputted by the classifiers. The confusion matrix reflects the historical reliability of decision-making of a classifier, while the difference between the classification confidence values for competing classes reflects the current reliability of its decision-making. The two factors are merged to obtain the weights of the classifiers’ classification confidence values for the input pattern. Then the classifiers are fused in a weighted-sum form. In our experiments of CISL recognition, we combine three types of classifiers: the Max-Min posterior Pseudo-probabilities (MMP), the Support Vector Machine (SVM) and the Bagging. Our method behaved better than not only each of the three single classifier but also the AdaBoost with SVM based weak learners. It shows that the proposed method is effective and promising.

[1]  Xiabi Liu,et al.  Using HOG-LBP features and MMP learning to recognize imaging signs of lung lesions , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[2]  Yixin Zhong,et al.  Breast Cancer Diagnosis Using Neural-Based Linear Fusion Strategies , 2006, ICONIP.

[3]  Shoji Kido,et al.  Classification of patterns for diffuse lung diseases in thoracic CT images by AdaBoost algorithm , 2009, Medical Imaging.

[4]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[5]  Michalis E. Zervakis,et al.  Classifier Fusion Approaches for Diagnostic Cancer Models , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Francis K. H. Quek,et al.  Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets , 2003, Pattern Recognit..

[7]  Michael F. McNitt-Gray,et al.  Automated classification of lung bronchovascular anatomy in CT using AdaBoost , 2007, Medical Image Anal..

[8]  Beatrice Lazzerini,et al.  Computer-aided detection of lung nodules based on decision fusion techniques , 2011, Pattern Analysis and Applications.

[9]  X. Chen,et al.  Learning Handwritten Digit Recognition by the Max-Min Posterior Pseudo-Probabilities Method , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[10]  Wei Liu,et al.  Multi-agent method for masses classification in mammogram , 2010, Medical Imaging.

[11]  Ian H. Witten,et al.  WEKA: a machine learning workbench , 1994, Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference.

[12]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[13]  Ke Wang,et al.  3D Matrix Pattern Based Support Vector Machines for Identifying Pulmonary Cancer in CT Scanned Images , 2010, Journal of Medical Systems.