Multi-Granularity Dilated Transformer for Lung Nodule Classification via Local Focus Scheme

Intelligent lung nodules classification is a meaningful and challenging research topic for early precaution of lung cancers, which aims to diagnose the malignancy of candidate nodules from the pulmonary computed tomography images. Nowadays, deep learning methods have made significant achievements in the medical field and promoted developments of lung nodules classification. Nevertheless, mainstream CNNs-based networks typically excel in learning coarse-grained local feature representations via stacked local-aware and weight-shared convolutions, and cannot practically model the long-range context interaction and the spatial dependencies. To tackle the above difficulties, we innovatively propose an effective Multi-Granularity Dilated Transformer to learn the long-range context relations, and explore fine-grained local details via the proposed Local Focus Scheme. Specifically, we delicately design a novel Deformable Dilated Transformer to incorporate diverse contextual information with self-attention for learning long-range global spatial dependencies. Moreover, numerous investigations indicate that local details are extremely crucial to classify indistinguishable lung nodules. Thus, we propose the Local Focus Scheme to focus on the more discriminative local features by modeling channel-wise grouped topology. Consequently, the Multi-Granularity Dilated Transformer is constructed by leveraging the Local Focus Scheme to guide the Deformable Dilated Transformer for learning fine-grained local cues. Experimental results on the mainstream benchmark LIDC-IDRI demonstrate the superiority of our model compared with the state-of-the-art methods.

[1]  Fei Gao,et al.  Learning Efficient, Explainable and Discriminative Representations for Pulmonary Nodules Classification , 2021, Pattern Recognit..

[2]  Su Ruan,et al.  Automatic COVID‐19 CT segmentation using U‐Net integrated spatial and channel attention mechanism , 2020, Int. J. Imaging Syst. Technol..

[3]  Maxine Tan,et al.  ProCAN: Progressive Growing Channel Attentive Non-Local Network for Lung Nodule Classification , 2020, Pattern Recognit..

[4]  Fei Gao,et al.  Attentive and ensemble 3D dual path networks for pulmonary nodules classification , 2020, Neurocomputing.

[5]  Jianyong Wang,et al.  MSCS-DeepLN: Evaluating lung nodule malignancy using multi-scale cost-sensitive neural networks , 2020, Medical Image Anal..

[6]  Bohyung Han,et al.  Channel Attention Is All You Need for Video Frame Interpolation , 2020, AAAI.

[7]  Jianpeng Zhang,et al.  Semi-supervised adversarial model for benign-malignant lung nodule classification on chest CT , 2019, Medical Image Anal..

[8]  Maxine Tan,et al.  Lung nodule classification using deep Local–Global networks , 2019, International Journal of Computer Assisted Radiology and Surgery.

[9]  Weidong Cai,et al.  Knowledge-based Collaborative Deep Learning for Benign-Malignant Lung Nodule Classification on Chest CT , 2019, IEEE Transactions on Medical Imaging.

[10]  Nadia Nedjah,et al.  Detection and classification of pulmonary nodules using deep learning and swarm intelligence , 2019, Multimedia Tools and Applications.

[11]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[12]  Denise R. Aberle,et al.  An Interpretable Deep Hierarchical Semantic Convolutional Neural Network for Lung Nodule Malignancy Classification , 2018, Expert Syst. Appl..

[13]  Anselmo Cardoso de Paiva,et al.  Lung nodules diagnosis based on evolutionary convolutional neural network , 2017, Multimedia Tools and Applications.

[14]  Dennis Wollersheim,et al.  Pulmonary nodule classification with deep residual networks , 2017, International Journal of Computer Assisted Radiology and Surgery.

[15]  Nima Tajbakhsh,et al.  Comparing two classes of end-to-end machine-learning models in lung nodule detection and classification: MTANNs vs. CNNs , 2017, Pattern Recognit..

[16]  Heng Huang,et al.  Lung Nodule Classification With Multilevel Patch-Based Context Analysis , 2014, IEEE Transactions on Biomedical Engineering.

[17]  Marcelo Gattass,et al.  Automatic segmentation of lung nodules with growing neural gas and support vector machine , 2012, Comput. Biol. Medicine.

[18]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[19]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[20]  H. Lee,et al.  Gated-Dilated Networks for Lung Nodule Classification in CT Scans , 2019, IEEE Access.

[21]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..