A Gradient Mapping Guided Explainable Deep Neural Network for Extracapsular Extension Identification in 3D Head and Neck Cancer Computed Tomography Images

Diagnosis and treatment management for head and neck squamous cell carcinoma (HNSCC) is guided by routine diagnostic head and neck computed tomography (CT) scans to identify tumor and lymph node features. Extracapsular extension (ECE) is a strong predictor of patients’ survival outcomes with HNSCC. It is essential to detect the occurrence of ECE as it changes staging and management for the patients. Current clinical ECE detection relies on visual identification and pathologic confirmation conducted by radiologists. Machine learning (ML)-based ECE diagnosis has shown high potential in the recent years. However, manual annotation of lymph node region is a required data preprocessing step in most of the current ML-based ECE diagnosis studies. In addition, this manual annotation process is time-consuming, labor-intensive, and error-prone. Therefore, in this paper, we propose a Gradient Mapping Guided Explainable Network (GMGENet) framework to perform ECE identification automatically without requiring annotated lymph node region information. The gradient-weighted class activation mapping (Grad-CAM) technique is proposed to guide the deep learning algorithm to focus on the regions that are highly ∗Corresponding author. E-mail address: wang@ise.msstate.edu Preprint submitted to Medical Image Analysis January 5, 2022 ar X iv :2 20 1. 00 89 5v 1 [ ee ss .I V ] 3 J an 2 02 2 related to ECE. Informative volumes of interest (VOIs) are extracted without labeled lymph node region information. In evaluation, the proposed method is well-trained and tested using cross validation, achieving test accuracy and AUC of 90.2% and 91.1%, respectively. The presence or absence of ECE has been analyzed and correlated with gold standard histopathological findings.

[1]  Hans Meine,et al.  Deep learning based automatic liver tumor segmentation in CT with shape-based post-processing , 2018 .

[2]  Amitojdeep Singh,et al.  Explainable Deep Learning Models in Medical Image Analysis , 2020, J. Imaging.

[3]  Anna Shcherbina,et al.  Not Just a Black Box: Learning Important Features Through Propagating Activation Differences , 2016, ArXiv.

[4]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[5]  Robert N. Anderson,et al.  Annual Report to the Nation on the Status of Cancer, 1975–2009, Featuring the Burden and Trends in Human Papillomavirus (HPV)–Associated Cancers and HPV Vaccination Coverage Levels , 2013, Journal of the National Cancer Institute.

[6]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[7]  Samuel Kadoury,et al.  Liver lesion segmentation informed by joint liver segmentation , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[8]  Linkan Bian,et al.  Extracapsular extension identification for head and neck cancer using multi-scale 3D deep neural network , 2021, BCB.

[9]  Avanti Shrikumar,et al.  Learning Important Features Through Propagating Activation Differences , 2017, ICML.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Dumitru Erhan,et al.  The (Un)reliability of saliency methods , 2017, Explainable AI.

[12]  Linkan Bian,et al.  3D Texture Feature-Based Lymph Node Automated Detection in Head and Neck Cancer Analysis , 2020, 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[15]  Joseph Paul Cohen,et al.  Uniformizing Techniques to Process CT scans with 3D CNNs for Tuberculosis Prediction , 2020, PRIME@MICCAI.

[16]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[17]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  E. Takaya,et al.  Deep Learning for the Preoperative Diagnosis of Metastatic Cervical Lymph Nodes on Contrast-Enhanced Computed ToMography in Patients with Oral Squamous Cell Carcinoma , 2021, Cancers.

[20]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  John Muschelli,et al.  Recommendations for Processing Head CT Data , 2019, Front. Neuroinform..

[22]  Steve B. Jiang,et al.  Combining many-objective radiomics and 3D convolutional neural network through evidential reasoning to predict lymph node metastasis in head and neck cancer , 2018, Physics in medicine and biology.

[23]  R. Decker,et al.  Pretreatment Identification of Head and Neck Cancer Nodal Metastasis and Extranodal Extension Using Deep Learning Neural Networks , 2018, Scientific Reports.

[24]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  W. Yarbrough,et al.  Multi-Institutional Validation of Deep Learning for Pretreatment Identification of Extranodal Extension in Head and Neck Squamous Cell Carcinoma. , 2019, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[26]  A. Katsumata,et al.  Contrast-enhanced computed tomography image assessment of cervical lymph node metastasis in patients with oral cancer by using a deep learning system of artificial intelligence. , 2019, Oral surgery, oral medicine, oral pathology and oral radiology.

[27]  Klaus-Robert Müller,et al.  Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models , 2017, ArXiv.

[28]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[29]  Y. Ariji,et al.  Automatic detection of cervical lymph nodes in patients with oral squamous cell carcinoma using a deep learning technique: a preliminary study , 2020, Oral Radiology.

[30]  Martin Wattenberg,et al.  SmoothGrad: removing noise by adding noise , 2017, ArXiv.

[31]  Skylar S. Gay,et al.  Generating High-Quality Lymph Node Clinical Target Volumes for Head and Neck Cancer Radiation Therapy Using a Fully Automated Deep Learning-Based Approach , 2020, International journal of radiation oncology, biology, physics.

[32]  Tsung-Ying Ho,et al.  Classifying Neck Lymph Nodes of Head and Neck Squamous Cell Carcinoma in MRI Images with Radiomic Features , 2020, Journal of Digital Imaging.

[33]  Ankur Taly,et al.  Axiomatic Attribution for Deep Networks , 2017, ICML.

[34]  Ghulam Rasool,et al.  Robust Explainability: A tutorial on gradient-based attribution methods for deep neural networks , 2021, IEEE Signal Processing Magazine.