Segmentation of glandular epithelium in colorectal tumours to automatically compartmentalise IHC biomarker quantification: A deep learning approach

HighlightsWe propose a method to automate glandular epithelium segmentation.Our approach combines Deep Learning and a new method of data augmentation.Our algorithm efficiently processes H&E as well as IHC images.Our algorithm achieves state‐of‐the‐art performances.Our method enables to automate the compartmentalisation of IHC biomarker analyses. Graphical abstract Figure. No caption available. ABSTRACT In this paper, we propose a method for automatically annotating slide images from colorectal tissue samples. Our objective is to segment glandular epithelium in histological images from tissue slides submitted to different staining techniques, including usual haematoxylin‐eosin (H&E) as well as immunohistochemistry (IHC). The proposed method makes use of Deep Learning and is based on a new convolutional network architecture. Our method achieves better performances than the state of the art on the H&E images of the GlaS challenge contest, whereas it uses only the haematoxylin colour channel extracted by colour deconvolution from the RGB images in order to extend its applicability to IHC. The network only needs to be fine‐tuned on a small number of additional examples to be accurate on a new IHC dataset. Our approach also includes a new method of data augmentation to achieve good generalisation when working with different experimental conditions and different IHC markers. We show that our methodology enables to automate the compartmentalisation of the IHC biomarker analysis, results concurring highly with manual annotations.

[1]  Hao Chen,et al.  DCAN: Deep contour‐aware networks for object instance segmentation from histology images , 2017, Medical Image Anal..

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Nasir M. Rajpoot,et al.  A Stochastic Polygons Model for Glandular Structures in Colon Histology Images , 2015, IEEE Transactions on Medical Imaging.

[4]  Anant Madabhushi,et al.  AUTOMATED GRADING OF PROSTATE CANCER USING ARCHITECTURAL AND TEXTURAL IMAGE FEATURES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[6]  Bram van Ginneken,et al.  The importance of stain normalization in colorectal tissue classification with convolutional networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[7]  Ovidiu Daescu,et al.  Histopathological Diagnosis for Viable and Non-viable Tumor Prediction for Osteosarcoma Using Convolutional Neural Network , 2017, ISBRA.

[8]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Yang Li,et al.  Gland Instance Segmentation Using Deep Multichannel Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[11]  Isabelle Salmon,et al.  Impact of neoadjuvant therapy on cancer-associated fibroblasts in rectal cancer. , 2015, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[12]  Anant Madabhushi,et al.  Automated gland and nuclei segmentation for grading of prostate and breast cancer histopathology , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Cenk Sokmensuer,et al.  Multilevel Segmentation of Histopathological Images Using Cooccurrence of Tissue Objects , 2012, IEEE Transactions on Biomedical Engineering.

[14]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[15]  Francesco Bianconi,et al.  Multi-class texture analysis in colorectal cancer histology , 2016, Scientific Reports.

[16]  Cenk Sokmensuer,et al.  Color Graphs for Automated Cancer Diagnosis and Grading , 2010, IEEE Transactions on Biomedical Engineering.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Cenk Sokmensuer,et al.  Local Object Patterns for the Representation and Classification of Colon Tissue Images , 2014, IEEE Journal of Biomedical and Health Informatics.

[19]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[20]  Zhipeng Jia,et al.  Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features , 2017, BMC Bioinformatics.

[21]  Cigdem Demir,et al.  Graph Run-Length Matrices for Histopathological Image Segmentation , 2011, IEEE Transactions on Medical Imaging.

[22]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Justine Allard,et al.  Image processing in digital pathology: an opportunity to solve inter-batch variability of immunohistochemical staining , 2017, Scientific Reports.

[25]  Serge J. Belongie,et al.  Unsupervised Color Decomposition Of Histologically Stained Tissue Samples , 2003, NIPS.

[26]  C Decaestecker,et al.  Epithelial expression of FHL2 is negatively associated with metastasis-free and overall survival in colorectal cancer , 2013, British Journal of Cancer.

[27]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[28]  Hao Chen,et al.  Gland segmentation in colon histology images: The glas challenge contest , 2016, Medical Image Anal..

[29]  Gustavo K. Rohde,et al.  Epithelium-Stroma Classification via Convolutional Neural Networks and Unsupervised Domain Adaptation in Histopathological Images , 2017, IEEE Journal of Biomedical and Health Informatics.

[30]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.