A comparative study of CNN, BoVW and LBP for classification of histopathological images

Despite the progress made in the field of medical imaging, it remains a large area of open research, especially due to the variety of imaging modalities and disease-specific characteristics. This paper is a comparative study describing the potential of using local binary patterns (LBP), deep features and the bag-of-visual words (BoVW) scheme for the classification of histopathological images. We introduce a new dataset, KIMIA Path960, that contains 960 histopathology images belonging to 20 different classes (different tissue types). We make this dataset publicly available. The small size of the dataset and its inter-and intra-class variability makes it ideal for initial investigations when comparing image descriptors for search and classification in complex medical imaging cases like histopathology. We investigate deep features, LBP histograms and BoVW to classify the images via leave-one-out validation. The accuracy of image classification obtained using LBP was 90.62% while the highest accuracy using deep features reached 94.72%. The dictionary approach (BoVW) achieved 96.50%. Deep solutions may be able to deliver higher accuracies but they need extensive training with a large number of (balanced) image datasets.

[1]  Pierluigi Carcagnì,et al.  TLD and Struck: A Feature Descriptors Comparative Study , 2014, AMMDS.

[2]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[3]  Dirk R. Padfield,et al.  Color and texture based segmentation of molecular pathology images usING HSOMS , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[4]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[5]  Kim L. Boyer,et al.  Computer-aided evaluation of neuroblastoma on whole-slide histology images: Classifying grade of neuroblastic differentiation , 2009, Pattern Recognit..

[6]  Shahryar Rahnamayan,et al.  Classification and Retrieval of Digital Pathology Scans: A New Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Rangaraj M. Rangayyan,et al.  Analysis of asymmetry in mammograms via directional filtering with Gabor wavelets , 2001, IEEE Transactions on Medical Imaging.

[8]  Xavier Lladó,et al.  False Positive Reduction in Mammographic Mass Detection Using Local Binary Patterns , 2007, MICCAI.

[9]  Saeid Nahavandi,et al.  Bag-of-words representation for biomedical time series classification , 2012, Biomed. Signal Process. Control..

[10]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.

[11]  Rudolf Hanka,et al.  Histological image retrieval based on semantic content analysis , 2003, IEEE Transactions on Information Technology in Biomedicine.

[12]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[14]  P. Nagabhushan,et al.  GLCM-based chi-square histogram distance for automatic detection of defects on patterned textures , 2011, Int. J. Comput. Vis. Robotics.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Marek Kowal,et al.  Classification of breast cancer cytological specimen using convolutional neural network , 2017 .

[17]  Ulysses J. Balis,et al.  Why a pathology image should not be considered as a radiology image , 2011, Journal of pathology informatics.

[18]  Jalel Akaichi,et al.  Using a bag of Words for Automatic Medical Image Annotation with a Latent Semantic , 2013, ArXiv.

[19]  Joel H. Saltz,et al.  Automatic histopathology image analysis with CNNs , 2016, 2016 New York Scientific Data Summit (NYSDS).

[20]  Rudolf Hanka,et al.  A multi-window approach to classify histological features , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[21]  Jyotirmoy Chatterjee,et al.  Quantitative dimensions of histopathological attributes and status of GSTM1-GSTT1 in oral submucous fibrosis. , 2008, Tissue & cell.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  P H Bartels,et al.  Bayesian belief networks in quantitative histopathology. , 1992, Analytical and quantitative cytology and histology.

[24]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Swapna Banerjee,et al.  Quantitative Analysis of Histopathological Features of Precancerous Lesion and Condition Using Image Processing Technique , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[26]  Fabio A. González,et al.  Histopathology Image Classification Using Bag of Features and Kernel Functions , 2009, AIME.

[27]  Bayan S. Sharif,et al.  Morphological and texture features for cancer tissues microscopic images , 2003, SPIE Medical Imaging.

[28]  T M Lehmann,et al.  Content-based Image Retrieval in Medical Applications , 2004, Methods of Information in Medicine.

[29]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[30]  Jun Kong,et al.  Digital Pathology: Data-Intensive Frontier in Medical Imaging , 2012, Proceedings of the IEEE.

[31]  Fabio A. González,et al.  A Semantic Content-Based Retrieval Method for Histopathology Images , 2008, AIRS.

[32]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[33]  Yongyi Yang,et al.  Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances , 2009, IEEE Transactions on Information Technology in Biomedicine.

[34]  Max A. Viergever,et al.  Breast Cancer Histopathology Image Analysis: A Review , 2014, IEEE Transactions on Biomedical Engineering.

[35]  Fang Zhang,et al.  Deep convolutional activation features for large scale Brain Tumor histopathology image classification and segmentation , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  Andrew A. Renshaw,et al.  Rubin??s Pathology. Clinicopathologic Foundations of Medicine , 2008 .

[37]  Janne Heikkilä,et al.  Transfer Learning for Cell Nuclei Classification in Histopathology Images , 2016, ECCV Workshops.

[38]  Michael Werman,et al.  The Quadratic-Chi Histogram Distance Family , 2010, ECCV.

[39]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[40]  Lei Zheng,et al.  Design and analysis of a content-based pathology image retrieval system , 2003, IEEE Transactions on Information Technology in Biomedicine.

[41]  B K Rutt,et al.  Invasive carcinomas and fibroadenomas of the breast: comparison of microvessel distributions--implications for imaging modalities. , 1998, Radiology.

[42]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[43]  Saeid Nahavandi,et al.  A deep-structural medical image classification for a Radon-based image retrieval , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[44]  Ahmet Ekin,et al.  Intensity versus texture for medical image search and retrival , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.