Deep Fisher Vector Coding For Whole Slide Image Classification

Adopting machine learning methods for histological sections is a challenging task given the generated huge size of whole slide images (WSIs) especially using high power resolution. In this paper we propose a novel WSI classification method which efficiently predicts a WSI’s label. The proposed method considers each WSI as a population of patches and computes a statistic by having some samples from the population. This statistic can be computed efficiently, and our test time on a WSI is about one tenth of that of the existing methods. Moreover, our pooling strategy on the WSI is more general than that of previous works. Further, the assumptions of our method are quite general, and therefore, it is applicable to any WSI classification task. The experiments show that the performance of our method is competitive in two different tasks, while, unlike some of the competing methods, it does not consider any prior clinical knowledge about the label to be predicted.

[1]  Clive R. Taylor,et al.  Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology , 2017, The American journal of surgical pathology.

[2]  Steven J. M. Jones,et al.  Molecular Profiling Reveals Biologically Discrete Subsets and Pathways of Progression in Diffuse Glioma , 2016, Cell.

[3]  Ramakrishnan Mukundan,et al.  HER2 challenge contest: a detailed assessment of automated HER2 scoring algorithms in whole slide images of breast cancer tissues , 2017, Histopathology.

[4]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ronnachai Jaroensri,et al.  Artificial intelligence in digital breast pathology: Techniques and applications , 2019, Breast.

[6]  Verónica Vilaplana,et al.  Monte-Carlo Sampling Applied to Multiple Instance Learning for Histological Image Classification , 2018, DLMIA/ML-CDS@MICCAI.

[7]  V. K. Govindan,et al.  Enhanced bag of visual words representations for content based image retrieval: a comparative study , 2019, Artificial Intelligence Review.

[8]  Francesco Ciompi,et al.  Neural Image Compression for Gigapixel Histopathology Image Analysis , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  T. Hampton,et al.  The Cancer Genome Atlas , 2020, Indian Journal of Medical and Paediatric Oncology.

[10]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Olivier Gevaert,et al.  Deep Recurrent Attention Models for Histopathological Image Analysis , 2018, bioRxiv.

[12]  J. S. Marron,et al.  Multiple Instance Learning for Heterogeneous Images: Training a CNN for Histopathology , 2018, MICCAI.

[13]  Matthieu Cord,et al.  WILDCAT: Weakly Supervised Learning of Deep ConvNets for Image Classification, Pointwise Localization and Segmentation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Junzhou Huang,et al.  Rectified Cross-Entropy and Upper Transition Loss for Weakly Supervised Whole Slide Image Classifier , 2019, MICCAI.

[15]  Neofytos Dimitriou,et al.  Deep Learning for Whole Slide Image Analysis: An Overview , 2019, Front. Med..

[16]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[17]  Matthieu Cord,et al.  WELDON: Weakly Supervised Learning of Deep Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Ziqiang Li,et al.  DA-RefineNet:A Dual Input Whole Slide Image Segmentation Algorithm Based on Attention , 2019, ArXiv.