Unbalanced data classification using support vector machines with active learning on scleroderma lung disease patterns

Unbalanced data classification has been a long-standing issue in the field of medical vision science. We introduced the methods of support vector machines (SVM) with active learning (AL) to improve prediction of unbalanced classes in the medical imaging field. A standard SVM algorithm with four different AL approaches are proposed: (1) The first one uses random sampling to select the initial pool with AL algorithm; (2) the second doubles the training instances of the rare category to reduce the unbalanced ratio before the AL algorithm; (3) the third uses a balanced pool with equal number from each category; and (4) the fourth uses a balanced pool and implements balanced sampling throughout the AL algorithm. Grid pixel data of two scleroderma lung disease patterns, lung fibrosis (LF), and honeycomb (HC) were extracted from computed tomography images of 71 patients to produce a training set of 348 HC and 3009 LF instances and a test set of 291 HC and 2665 LF. From our research, SVM with AL using balanced sampling compared to random sampling increased the test sensitivity of HC by 56% (17.5% vs. 73.5%) and 47% (23% vs. 70%) for the original and denoised dataset, respectively. SVM with AL with balanced sampling can improve the classification performances of unbalanced data.

[1]  E. V. van Beek,et al.  Computer-aided classification of interstitial lung diseases via MDCT: 3D adaptive multiple feature method (3D AMFM). , 2006, Academic radiology.

[2]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[3]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[4]  E. Hoffman,et al.  Interstitial lung disease: A quantitative study using the adaptive multiple feature method. , 1999, American journal of respiratory and critical care medicine.

[5]  Sumit K. Shah,et al.  Classification of parenchymal abnormality in scleroderma lung using a novel approach to denoise images collected via a multicenter study. , 2008, Academic radiology.

[6]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[7]  Stephen Kwek,et al.  Applying Support Vector Machines to Imbalanced Datasets , 2004, ECML.

[8]  Antonin Chambolle,et al.  Dual Norms and Image Decomposition Models , 2005, International Journal of Computer Vision.

[9]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  A. Hero,et al.  A Fast Spectral Method for Active 3D Shape Reconstruction , 2004 .

[11]  C. Lee Giles,et al.  Learning on the border: active learning in imbalanced data classification , 2007, CIKM '07.

[12]  Ilias Maglogiannis,et al.  Characterization of digital medical images utilizing support vector machines , 2004, BMC Medical Informatics Decis. Mak..

[13]  Damian McEntegart,et al.  Weighted re‐randomization tests for minimization with unbalanced allocation , 2013, Pharmaceutical statistics.

[14]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[15]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[16]  A Kahn,et al.  Interstitial lung disease. , 1982, The Journal of the Arkansas Medical Society.

[17]  E.E. Pissaloux,et al.  Image Processing , 1994, Proceedings. Second Euromicro Workshop on Parallel and Distributed Processing.

[18]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[19]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[20]  A. Agresti An introduction to categorical data analysis , 1997 .

[21]  J. Tebbs,et al.  An Introduction to Categorical Data Analysis , 2008 .

[22]  Bernhard Schölkopf,et al.  Sparse Greedy Matrix Approximation for Machine Learning , 2000, International Conference on Machine Learning.

[23]  D. Hansell,et al.  Obstructive lung diseases: texture classification for differentiation at CT. , 2003, Radiology.

[24]  D. Lynch,et al.  Interobserver variability in the CT assessment of honeycombing in the lungs. , 2013, Radiology.

[25]  C. A. Murthy,et al.  A probabilistic active support vector learning algorithm , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..