Autonomous Extraction of Gleason Patterns for Grading Prostate Cancer using Multi-Gigapixel Whole Slide Images

Prostate cancer (PCa) is the second deadliest form of cancer in males. The severity of PCa can be clinically graded through the Gleason scores obtained by examining the structural representation of Gleason cellular patterns. This paper presents an asymmetric encoder-decoder model that integrates a novel hierarchical decomposition block to exploit the feature representations pooled across various scales and then fuses them together to generate the Gleason cellular patterns using the whole slide images. Furthermore, the proposed network is penalized through a novel three-tiered hybrid loss function which ensures that the proposed model accurately recognizes the cluttered regions of the cancerous tissues despite having similar contextual and textural characteristics. We have rigorously tested the proposed network on 10,516 whole slide scans (containing around 71.7M patches), where the proposed model achieved 3.59\% improvement over state-of-the-art scene parsing, encoder-decoder, and fully convolutional networks in terms of intersection-over-union.

[1]  Taimur Hassan,et al.  RAG-FW: A Hybrid Convolutional Framework for the Automated Extraction of Retinal Lesions and Lesion-Influenced Grading of Human Retinal Pathology , 2020, IEEE Journal of Biomedical and Health Informatics.

[2]  R. Kumar,et al.  Detection and Classification of Cancer from Microscopic Biopsy Images Using Clinically Significant and Biologically Interpretable Features , 2015, Journal of medical engineering.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[5]  T. Hermanns,et al.  Automated Gleason grading of prostate cancer tissue microarrays via deep learning , 2018, Scientific Reports.

[6]  A. Jemal,et al.  Cancer statistics, 2015 , 2015, CA: a cancer journal for clinicians.

[7]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[8]  Nico Karssemeijer,et al.  Computer-Aided Detection of Prostate Cancer in MRI , 2014, IEEE Transactions on Medical Imaging.

[9]  Naimul Mefraz Khan,et al.  A Novel Focal Tversky Loss Function With Improved Attention U-Net for Lesion Segmentation , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[10]  Xin Qi,et al.  Exploring automatic prostate histopathology image gleason grading via local structure modeling , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  N. Dubrawsky Cancer statistics , 1989, CA: a cancer journal for clinicians.

[12]  Ammara Nasim,et al.  Automated Gland Segmentation Leading to Cancer Detection for Colorectal Biopsy Images , 2019, Lecture Notes in Networks and Systems.

[13]  Onno J de Boer,et al.  Deep learning for automatic Gleason pattern classification for grade group determination of prostate biopsies , 2019, Virchows Archiv.

[14]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[16]  S Bruce Malkowicz,et al.  Identification of clinically significant prostate cancer by prostate-specific antigen screening. , 2004, Archives of internal medicine.

[17]  Ellery Wulczyn,et al.  Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer , 2018, npj Digital Medicine.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Tao Liu,et al.  Searching for prostate cancer by fully automated magnetic resonance imaging classification: deep learning versus non-deep learning , 2017, Scientific Reports.

[20]  Matthias Waldert,et al.  Prostate cancer in elderly men. , 2008, Reviews in urology.

[21]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  J. Epstein,et al.  Defining clinically significant prostate cancer on the basis of pathological findings , 2018, Histopathology.

[23]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[24]  Xin Yang,et al.  Automated Detection of Clinically Significant Prostate Cancer in mp-MRI Images Based on an End-to-End Deep Neural Network , 2018, IEEE Transactions on Medical Imaging.