Deep Features for Tissue-Fold Detection in Histopathology Images

Whole slide imaging (WSI) refers to the digitization of a tissue specimen which enables pathologists to explore high-resolution images on a monitor rather than through a microscope. The formation of tissue folds occur during tissue processing. Their presence may not only cause out-of-focus digitization but can also negatively affect the diagnosis in some cases. In this paper, we have compared five pre-trained convolutional neural networks (CNNs) of different depths as feature extractors to characterize tissue folds. We have also explored common classifiers to discriminate folded tissue against the normal tissue in hematoxylin and eosin (H\&E) stained biopsy samples. In our experiments, we manually select the folded area in roughly 2.5mm $\times$ 2.5mm patches at $20$x magnification level as the training data. The ``DenseNet'' with 201 layers alongside an SVM classifier outperformed all other configurations. Based on the leave-one-out validation strategy, we achieved $96.3\%$ accuracy, whereas with augmentation the accuracy increased to $97.2\%$. We have tested the generalization of our method with five unseen WSIs from the NIH (National Cancer Institute) dataset. The accuracy for patch-wise detection was $81\%$. One folded patch within an image suffices to flag the entire specimen for visual inspection.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Shaimaa Al-Janabi,et al.  Digital pathology: current status and future perspectives , 2012, Histopathology.

[3]  Yukako Yagi,et al.  Detection of tissue folds in whole slide images , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Liron Pantanowitz,et al.  Artificial Intelligence and Digital Pathology: Challenges and Opportunities , 2018, Journal of pathology informatics.

[5]  Hong Liu,et al.  Coarse to fine K nearest neighbor classifier , 2013, Pattern Recognit. Lett..

[6]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[7]  Jaime S. Cardoso,et al.  Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support , 2017, Lecture Notes in Computer Science.

[8]  Bram van Ginneken,et al.  Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[9]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  R. Krishnapillai,et al.  Facts in artifacts , 2013, Journal of oral and maxillofacial pathology : JOMFP.

[12]  May D. Wang,et al.  Biological interpretation of morphological patterns in histopathological whole-slide images , 2012, BCB.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yukako Yagi,et al.  Improving the visualization and detection of tissue folds in whole slide images through color enhancement , 2010, Journal of pathology informatics.

[15]  Hamid R. Tizhoosh,et al.  Deep Barcodes for Fast Retrieval of Histopathology Scans , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[16]  May D. Wang,et al.  Eliminating tissue-fold artifacts in histopathological whole-slide images for improved image-based prediction of cancer grade , 2013, Journal of pathology informatics.

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Hamid R. Tizhoosh,et al.  Convolutional neural networks for histopathology image classification: Training vs. Using pre-trained networks , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[19]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[20]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[21]  Saeid Nahavandi,et al.  Parallel deep solutions for image retrieval from imbalanced medical imaging archives , 2018, Appl. Soft Comput..

[22]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..