Knowledge-Guided And Hyper-Attention Aware Joint Network For Benign-Malignant Lung Nodule Classification

Accurate identification and early diagnosis of malignant lung nodules are crucial for improving the survival rate of patients with lung cancer. Deep learning methods have recently been proven success in computer-aided diagnostic tasks. However, to the best of our knowledge, the features of tissues and vessels will disturb the model resulting in inaccurate classification of the nodules. To reduce the interference and capture crucial contextual information from different channels in a more efficient way, we introduce a Hyper-Attention Mechanism(HAM) that can be easily integrated into convolutional neural networks(CNNs). Moreover, without incorporating prior-domain knowledge, traditional methods lack interpretability, which is difficult to understand and utilize them in the clinic by radiologists. Based on this, we propose a novel Knowledge-Guided model to predict malignant pulmonary nodules from chest CT data, which inject external medical knowledge into CNNs to guide the training process. We evaluate the proposed model on the LIDC-IDRI dataset and demonstrate its effectiveness by achieving comparable state-of-the-art performance.

[1]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[2]  Nenghai Yu,et al.  Flow Guided Siamese Network for Visual Tracking , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[3]  Maxine Tan,et al.  Lung nodule classification using deep Local–Global networks , 2019, International Journal of Computer Assisted Radiology and Surgery.

[4]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[5]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[6]  Shiqian Ma,et al.  Highly accurate model for prediction of lung nodule malignancy with CT scans , 2018, Scientific Reports.

[7]  A. Jemal,et al.  Cancer statistics, 2016 , 2016, CA: a cancer journal for clinicians.

[8]  Hong Zhao,et al.  Texture Feature Analysis for Computer-Aided Diagnosis on Pulmonary Nodules , 2015, Journal of Digital Imaging.

[9]  Ulas Bagci,et al.  TumorNet: Lung nodule characterization using multi-view Convolutional Neural Network with Gaussian Process , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[10]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[11]  Guoying Zhao,et al.  Video Action Recognition Via Neural Architecture Searching , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[12]  Application of Modified Inception-ResNet and CondenseNet in Lung Nodule Classification , 2019 .

[13]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[16]  Denise R. Aberle,et al.  An Interpretable Deep Hierarchical Semantic Convolutional Neural Network for Lung Nodule Malignancy Classification , 2018, Expert Syst. Appl..

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.