SlideNet: Fast and Accurate Slide Quality Assessment Based on Deep Neural Networks

This work tackles the automatic fine-grained slide quality assessment problem for digitized direct smears test using the Gram staining protocol. Automatic quality assessment can provide useful information for the pathologists and the whole digital pathology workflow. For instance, if the system found a slide to have a low staining quality, it could send a request to the automatic slide preparation system to remake the slide. If the system detects severe damage in the slides, it could notify the experts that manual microscope reading may be required. In order to address the quality assessment problem, we propose a deep neural network based framework to automatically assess the slide quality in a semantic way. Specifically, the first step of our framework is to perform dense fine-grained region classification on the whole slide and calculate the region histogram of the label distributions. Next, our framework will generate assessments of the slide quality from various perspectives: staining quality, information density, damage level and which regions are more valuable for subsequent high-magnification analysis. To make the information more accessible, we present our results in the form of a heat map and text summaries. Additionally, in order to stimulate research in this direction, we propose a novel dataset for slide quality assessment. Experiments show that the proposed framework outperforms recent related works.

[1]  P. S. Hiremath,et al.  Automatic Identification and Classification of Bacilli Bacterial Cell Growth Phases , 2010 .

[2]  Syed Muhammad Anwar,et al.  Deep Learning in Medical Image Analysis , 2017 .

[3]  Matti Pietikäinen,et al.  Capturing correlations of local features for image representation , 2016, Neurocomputing.

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Forrest N. Iandola,et al.  Keynote: small neural nets are beautiful: enabling embedded systems with small deep-neural- network architectures , 2017, 2017 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS).

[6]  Tom Kimpe,et al.  Automatic Image Quality Assessment for Digital Pathology , 2016, Digital Mammography / IWDM.

[7]  Alison D. Grant,et al.  “Proof-Of-Concept” Evaluation of an Automated Sputum Smear Microscopy System for Tuberculosis Diagnosis , 2012, PloS one.

[8]  Yoshihiro Hirohashi,et al.  Segmental HOG: new descriptor for glomerulus detection in kidney microscopy image , 2015, BMC Bioinformatics.

[9]  M. L. Chayadevi,et al.  Extraction of Bacterial Clusters from Digital Microscopic Images through Statistical and Neural Network Approaches , 2013 .

[10]  Yun Tian,et al.  Automatic Classification of Human Embryo Microscope Images Based on LBP Feature , 2014, IGTA.

[11]  Brian C. Lovell,et al.  A multiple covariance approach for cell detection of Gram-stained smears images , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Milos Hauskrecht,et al.  Active Learning of Classification Models from Soft-Labeled Groups , 2017 .

[13]  Paul Singleton,et al.  Dictionary of Microbiology and Molecular Biology , 1993 .

[14]  Hariharan Ravishankar,et al.  Understanding the Mechanisms of Deep Transfer Learning for Medical Images , 2016, LABELS/DLMIA@MICCAI.

[15]  J. Bartholomew,et al.  THE GRAM STAIN , 1952, Bacteriological reviews.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Brian C. Lovell,et al.  TV-GAN: Generative Adversarial Network Based Thermal to Visible Face Recognition , 2017, 2018 International Conference on Biometrics (ICB).

[18]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[19]  P H Bartels,et al.  Histometric features for the grading of prostatic carcinoma. , 1991, Analytical and quantitative cytology and histology.

[20]  Abdul-Saboor Sheikh,et al.  Neural Simpletrons - Minimalistic Directed Generative Networks for Learning with Few Labels , 2015, 1506.08448.

[21]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[22]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[23]  Tao Xu,et al.  Integrated local binary pattern texture features for classification of breast tissue imaged by optical coherence microscopy , 2017, Medical Image Anal..

[24]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[26]  Yaozong Gao,et al.  Learning to Rank Atlases for Multiple-Atlas Segmentation , 2014, IEEE Transactions on Medical Imaging.

[27]  Banshidhar Majhi,et al.  Microscopic Image Classification Using DCT for the Detection of Acute Lymphoblastic Leukemia (ALL) , 2016, CVIP.

[28]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Paul J Tadrous,et al.  Computer-assisted screening of Ziehl-Neelsen-stained tissue for mycobacteria. Algorithm design and preliminary studies on 2,000 images. , 2010, American journal of clinical pathology.

[30]  Jyotirmoy Chatterjee,et al.  Automated oral cancer identification using histopathological images: a hybrid feature extraction paradigm. , 2012, Micron.

[31]  Brian C. Lovell,et al.  An Early Experience Toward Developing Computer Aided Diagnosis for Gram-Stained Smears Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  A. Janin,et al.  Stack or trash? Quality assessment of virtual slides , 2013, Diagnostic Pathology.

[33]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.