Segmenting Potentially Cancerous Areas in Prostate Biopsies using Semi-Automatically Annotated Data

Gleason grading specified in ISUP 2014 is the clinical standard in staging prostate cancer and the most important part of the treatment decision. However, the grading is subjective and suffers from high intra and inter-user variability. To improve the consistency and objectivity in the grading, we introduced glandular tissue WithOut Basal cells (WOB) as the ground truth. The presence of basal cells is the most accepted biomarker for benign glandular tissue and the absence of basal cells is a strong indicator of acinar prostatic adenocarcinoma, the most common form of prostate cancer. Glandular tissue can objectively be assessed as WOB or not WOB by using specific immunostaining for glandular tissue (Cytokeratin 8/18) and for basal cells (Cytokeratin 5/6 + p63). Even more, WOB allowed us to develop a semi-automated data generation pipeline to speed up the tremendously time consuming and expensive process of annotating whole slide images by pathologists. We generated 295 prostatectomy images exhaustively annotated with WOB. Then we used our Deep Learning Framework, which achieved the $2^{nd}$ best reported score in Camelyon17 Challenge, to train networks for segmenting WOB in needle biopsies. Evaluation of the model on 63 needle biopsies showed promising results which were improved further by finetuning the model on 118 biopsies annotated with WOB, achieving F1-score of 0.80 and Precision-Recall AUC of 0.89 at the pixel-level. Then we compared the performance of the model against 17 biopsies annotated independently by 3 pathologists using only H\&E staining. The comparison demonstrated that the model performed on a par with the pathologists. Finally, the model detected and accurately outlined existing WOB areas in two biopsies incorrectly annotated as totally WOB-free biopsies by three pathologists and in one biopsy by two pathologists.

[1]  Thomas J. Fuchs,et al.  Terabyte-scale Deep Multiple Instance Learning for Classification and Localization in Pathology , 2018, ArXiv.

[2]  Feng Gu,et al.  A Deep Learning Framework for Automatic Diagnosis in Lung Cancer , 2018, ArXiv.

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[5]  K. Trpkov,et al.  Usefulness of cytokeratin 5/6 and AMACR applied as double sequential immunostains for diagnostic assessment of problematic prostate specimens. , 2009, American journal of clinical pathology.

[6]  Ellery Wulczyn,et al.  Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer , 2018, npj Digital Medicine.

[7]  J. Epstein,et al.  Immunohistochemical Antibody Cocktail Staining (p63/HMWCK/AMACR) of Ductal Adenocarcinoma and Gleason Pattern 4 Cribriform and Noncribriform Acinar Adenocarcinomas of the Prostate , 2007, The American journal of surgical pathology.

[8]  Ni Chen,et al.  The evolving Gleason grading system. , 2016, Chinese journal of cancer research = Chung-kuo yen cheng yen chiu.

[9]  Aleksey Boyko,et al.  Detecting Cancer Metastases on Gigapixel Pathology Images , 2017, ArXiv.

[10]  Arkadiusz Gertych,et al.  A Multi-scale U-Net for Semantic Segmentation of Histological Images from Radical Prostatectomies , 2017, AMIA.

[11]  D. Gleason,et al.  PREDICTION OF PROGNOSIS FOR PROSTATIC ADENOCARCINOMA BY COMBINED HISTOLOGICAL GRADING AND CLINICAL STAGING , 2017, The Journal of urology.

[12]  T. Hermanns,et al.  Automated Gleason grading of prostate cancer tissue microarrays via deep learning , 2018, Scientific Reports.

[13]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Marius Pedersen,et al.  Y-Net: A deep Convolutional Neural Network for Polyp Detection , 2018, BMVC.

[15]  Nicolas Pinchaud,et al.  CAMELYON17 GRAND CHALLENGE , 2018 .

[16]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.