A U-net based approach to epidermal tissue segmentation in whole slide histopathological images

Malignant melanoma is a severe and aggressive type of skin cancer, with a rapid decrease in survival rate if not diagnosed and treated at an early stage. Histopathological examination of hematoxylin and eosin stained tissue biopsies under a light microscope is currently the gold standard for diagnosis. However, this manual examination is a difficult and time-consuming task, and diagnosis is often subject to intra- and inter-observer variability. With more pathology departments starting to convert conventional glass slides into digital resources, a Computer Aided Diagnostic (CAD) system that can automate part of the diagnostic process will help address these challenges. It is expected to reduce examination time, increase diagnostic accuracy, and reduce diagnostic variations. An important initial step in developing such a system is an automated epidermis segmentation algorithm, since several important diagnostic factors are within or seen relatively to the epidermis’ location. In this paper, we propose a new epidermis segmentation technique built on Convolutional Neural Networks. We trained an U-net based architecture end-to-end, with $$\sim 380\hbox {k}$$∼380k overlapping high resolution image patches at 512 $$\times$$× 512 pixels, extracted and augmented from 36 digitized histopathological images from two different clinical sites, to discriminate pixels as either epidermal or non-epidermal. The proposed technique was evaluated on 33 test images, where we achieved a mean Positive Predictive Value at $$0.89\pm 0.16$$0.89±0.16, Sensitivity at $$0.92\pm 0.1$$0.92±0.1, Dice Similarity Coefficient at $$0.89\pm 0.13$$0.89±0.13 and a Matthews Correlation Coefficient at $$0.89\pm 0.11$$0.89±0.11, showing a superior performance when compared to existing techniques. Our algorithm also proves to be robust to variations in staining, tissue thickness and laboratory pre-processing.

[1]  J. M. Crawford,et al.  Pathologist workforce in the United States: I. Development of a predictive model to examine factors influencing supply. , 2013, Archives of pathology & laboratory medicine.

[2]  Elaine B. Martin,et al.  Segmentation of epidermal tissue with histopathological damage in images of haematoxylin and eosin stained human skin , 2014, BMC Medical Imaging.

[3]  J. Naeyaert,et al.  Inter‐observer variation in the histopathological diagnosis of clinically suspicious pigmented skin lesions , 2002, The Journal of pathology.

[4]  G C Hitchcock,et al.  National Cancer Registry. , 1989, The New Zealand medical journal.

[5]  Joanna Jaworek-Korjakowska,et al.  Automated epidermis segmentation in histopathological images of human skin stained with hematoxylin and eosin , 2017, Medical Imaging.

[6]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Hongming Xu,et al.  Epidermis segmentation in skin histopathological images based on thickness measurement and k-means algorithm , 2015, EURASIP Journal on Image and Video Processing.

[10]  Maria Wimmer,et al.  Fully Convolutional Architectures for Multiclass Segmentation in Chest Radiographs , 2017, IEEE Transactions on Medical Imaging.

[11]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[12]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[15]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  S. Majumdar,et al.  Use of 2D U-Net Convolutional Neural Networks for Automated Cartilage and Meniscus Segmentation of Knee MR Imaging Data to Determine Relaxometry and Morphometry. , 2018, Radiology.

[17]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  A Rebora,et al.  Interobserver reproducibility of histological features in cutaneous malignant melanoma , 2005, Journal of Clinical Pathology.

[19]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Mrinal K. Mandal,et al.  Automated analysis and diagnosis of skin melanoma on whole slide histopathological images , 2015, Pattern Recognit..

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[24]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[27]  Davide Chicco,et al.  Ten quick tips for machine learning in computational biology , 2017, BioData Mining.