Colorectal tumor identification by transferring knowledge from pan-cytokeratin to H&E

Tumor budding is a recently recognized, independent prognostic factor in colorectal cancer, but lacks a standardized assessment methodology. Although staining with pan-cytokeratin has been shown to mitigate the issue of lack of reproducible, intra-observer agreement, usage of this antibody remains expensive and is limited in clinical practice. We propose an automated image analysis framework to take advantage of the visual superiority of pan-cytokeratin and the routine use of H&E to detect and quantify tumor budding. Our framework has demonstrated promising ability to identify tumor regions of colorectal slides – 92.0% accuracy, 94.5% sensitivity, and 85% specificity – across four independent datasets.

[1]  Phil Quirke,et al.  Recommendations for reporting tumor budding in colorectal cancer based on the International Tumor Budding Consensus Conference (ITBCC) 2016 , 2017, Modern Pathology.

[2]  Shigehisa Aoki,et al.  Cytokeratin immunohistochemistry improves interobserver variability between unskilled pathologists in the evaluation of tumor budding in T1 colorectal cancer , 2016, Pathology international.

[3]  Michael Goodman,et al.  Calculation of the Ki67 index in pancreatic neuroendocrine tumors: a comparative analysis of four counting methodologies , 2015, Modern Pathology.

[4]  T. Schaller,et al.  Interobserver variability in the H&E-based assessment of tumor budding in pT3/4 colon cancer: does it affect the prognostic relevance? , 2018, Virchows Archiv.

[5]  F. Offner,et al.  Tumor budding in colorectal cancer revisited: results of a multicenter interobserver study , 2015, Virchows Archiv.

[6]  A. Hartmann,et al.  Infiltrative lamina propria invasion pattern as an independent predictor for cancer‐specific and overall survival of instillation treatment‐naïve stage T1 high‐grade urothelial bladder cancer , 2018, International journal of urology : official journal of the Japanese Urological Association.

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  D. Bostwick,et al.  Substaging of T1 bladder carcinoma based on the depth of invasion as measured by micrometer , 1999, Cancer.

[9]  Berkman Sahiner,et al.  Nuclear IHC enumeration: A digital phantom to evaluate the performance of automated algorithms in digital pathology , 2018, PloS one.

[10]  Sam S. Chang,et al.  Challenges in the pathology of non-muscle-invasive bladder cancer: a dialogue between the urologic surgeon and the pathologist. , 2013, Urology.

[11]  Berkman Sahiner,et al.  Optimized generation of high-resolution phantom images using cGAN: Application to quantification of Ki67 breast cancer images , 2018, PloS one.

[12]  H. Gobbi,et al.  Inter-observer variability between general pathologists and a specialist in breast pathology in the diagnosis of lobular neoplasia, columnar cell lesions, atypical ductal hyperplasia and ductal carcinoma in situ of the breast , 2014, Diagnostic Pathology.

[13]  Michael W. Marcellin,et al.  Pathological image compression for big data image analysis: Application to hotspot detection in breast cancer , 2019, Artif. Intell. Medicine.

[14]  F. Prall Tumour budding in colorectal carcinoma , 2007, Histopathology.

[15]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  M. Khalid Khan,et al.  Entropy based quantification of Ki-67 positive cell images and its evaluation by a reader study , 2013, Medical Imaging.

[17]  Inti Zlobec,et al.  Tumor budding in colorectal cancer--ready for diagnostic practice? , 2016, Human pathology.

[18]  L. Terracciano,et al.  Tumor budding score based on 10 high-power fields is a promising basis for a standardized prognostic scoring system in stage II colorectal cancer. , 2013, Human pathology.

[19]  Liron Pantanowitz,et al.  Identifying tumor in pancreatic neuroendocrine neoplasms from Ki67 images using transfer learning , 2018, PloS one.

[20]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[21]  D. McMillan,et al.  The role of tumour budding in predicting survival in patients with primary operable colorectal cancer: a systematic review. , 2015, Cancer treatment reviews.

[22]  A. Rogers,et al.  Prognostic significance of tumor budding in rectal cancer biopsies before neoadjuvant therapy , 2014, Modern Pathology.

[23]  H. Lynch,et al.  Psychologic Aspects of Cancer Genetic Testing: A Research Update for Clinicians , 1997 .