ProCAN: Progressive Growing Channel Attentive Non-Local Network for Lung Nodule Classification

Lung cancer classification in screening computed tomography (CT) scans is one of the most crucial tasks for early detection of this disease. Many lives can be saved if we are able to accurately classify malignant/ cancerous lung nodules. Consequently, several deep learning based models have been proposed recently to classify lung nodules as malignant or benign. Nevertheless, the large variation in the size and heterogeneous appearance of the nodules makes this task an extremely challenging one. We propose a new Progressive Growing Channel Attentive Non-Local (ProCAN) network for lung nodule classification. The proposed method addresses this challenge from three different aspects. First, we enrich the Non-Local network by adding channel-wise attention capability to it. Second, we apply Curriculum Learning principles, whereby we first train our model on easy examples before hard/ difficult ones. Third, as the classification task gets harder during the Curriculum learning, our model is progressively grown to increase its capability of handling the task at hand. We examined our proposed method on two different public datasets and compared its performance with state-of-the-art methods in the literature. The results show that the ProCAN model outperforms state-of-the-art methods and achieves an AUC of 98.05% and accuracy of 95.28% on the LIDC-IDRI dataset. Moreover, we conducted extensive ablation studies to analyze the contribution and effects of each new component of our proposed method.

[1]  Jianyong Wang,et al.  MSCS-DeepLN: Evaluating lung nodule malignancy using multi-scale cost-sensitive neural networks , 2020, Medical Image Anal..

[2]  Maxine Tan,et al.  Lung nodule classification using deep Local–Global networks , 2019, International Journal of Computer Assisted Radiology and Surgery.

[3]  Qi Tian,et al.  Data Augmentation Revisited: Rethinking the Distribution Gap between Clean and Augmented Data , 2019, ArXiv.

[4]  Jan Cornelis,et al.  A novel computer-aided lung nodule detection system for CT images. , 2011, Medical physics.

[5]  Nadia Nedjah,et al.  Detection and classification of pulmonary nodules using deep learning and swarm intelligence , 2019, Multimedia Tools and Applications.

[6]  Bo Chen,et al.  Contrast agent-free synthesis and segmentation of ischemic heart disease images using progressive sequential causal GANs , 2020, Medical Image Anal..

[7]  Jianpeng Zhang,et al.  Semi-supervised adversarial model for benign-malignant lung nodule classification on chest CT , 2019, Medical Image Anal..

[8]  Shanq-Jang Ruan,et al.  Low order adaptive region growing for lung segmentation on plain chest radiographs , 2018, Neurocomputing.

[9]  Denise R. Aberle,et al.  An Interpretable Deep Hierarchical Semantic Convolutional Neural Network for Lung Nodule Malignancy Classification , 2018, Expert Syst. Appl..

[10]  Karen Drukker,et al.  LUNGx Challenge for computerized lung nodule classification , 2016, Journal of medical imaging.

[11]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[13]  Yanning Zhang,et al.  NODULe: Combining constrained multi-scale LoG filters with densely dilated 3D deep convolutional neural network for pulmonary nodule detection , 2018, Neurocomputing.

[14]  Shunxing Bao,et al.  Multi-path x-D recurrent neural networks for collaborative image classification , 2020, Neurocomputing.

[15]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[16]  Gary Marcus,et al.  Deep Learning: A Critical Appraisal , 2018, ArXiv.

[17]  Saeed Hassanpour,et al.  Learn like a Pathologist: Curriculum Learning by Annotator Agreement for Histopathology Image Classification , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[18]  C. Gatsonis,et al.  Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening , 2012 .

[19]  Dennis Wollersheim,et al.  Pulmonary nodule classification with deep residual networks , 2017, International Journal of Computer Assisted Radiology and Surgery.

[20]  P. Alam.  ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[21]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[22]  Fei Gao,et al.  Attentive and ensemble 3D dual path networks for pulmonary nodules classification , 2020, Neurocomputing.

[23]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Zhenyu Liu,et al.  Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation , 2017, Medical Image Anal..

[25]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[27]  Tanveer F. Syeda-Mahmood,et al.  Building medical image classifiers with very limited data using segmentation networks , 2018, Medical Image Anal..

[28]  Xin Jiang,et al.  A semi-supervised convolutional transfer neural network for 3D pulmonary nodules detection , 2020, Neurocomputing.

[29]  Ashish Vaswani,et al.  Stand-Alone Self-Attention in Vision Models , 2019, NeurIPS.

[30]  Stephen Lin,et al.  GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[31]  P. Alam.  ‘N’ , 2021, Composites Engineering: An A–Z Guide.

[32]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[33]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[34]  Dorit Merhof,et al.  Multi Scale Curriculum CNN for Context-Aware Breast MRI Malignancy Classification , 2019, MICCAI.

[35]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[36]  Anant Madabhushi,et al.  Intra-perinodular Textural Transition (Ipris): A 3D Descriptor for Nodule Diagnosis on Lung CT , 2017, MICCAI.

[37]  René M. Botnar,et al.  Automatic CNN-based detection of cardiac MR motion artefacts using k-space data augmentation and curriculum learning , 2018, Medical Image Anal..

[38]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[39]  Weidong Cai,et al.  Knowledge-based Collaborative Deep Learning for Benign-Malignant Lung Nodule Classification on Chest CT , 2019, IEEE Transactions on Medical Imaging.

[40]  Niranjan Khandelwal,et al.  A Combination of Shape and Texture Features for Classification of Pulmonary Nodules in Lung CT Images , 2016, Journal of Digital Imaging.

[41]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[42]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[43]  Nima Tajbakhsh,et al.  Comparing two classes of end-to-end machine-learning models in lung nodule detection and classification: MTANNs vs. CNNs , 2017, Pattern Recognit..

[44]  Ali Kashif Bashir,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2013, ICIRA 2013.

[45]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[47]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[48]  Quoc V. Le,et al.  Attention Augmented Convolutional Networks , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[49]  Dimitrios Korkinof,et al.  High-Resolution Mammogram Synthesis using Progressive Generative Adversarial Networks , 2018, ArXiv.

[50]  Hao Chen,et al.  Multi-Task Deep Model With Margin Ranking Loss for Lung Nodule Analysis , 2020, IEEE Transactions on Medical Imaging.

[51]  Ibrahim Saad Ali,et al.  Data Augmentation for Skin Lesion using Self-Attention based Progressive Generative Adversarial Network , 2021, Expert Syst. Appl..

[52]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[53]  Hwee Kuan Lee,et al.  Gated-Dilated Networks for Lung Nodule Classification in CT Scans , 2019, IEEE Access.

[54]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[55]  Xiaohui Xie,et al.  DeepLung: Deep 3D Dual Path Nets for Automated Pulmonary Nodule Detection and Classification , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[56]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[57]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..