Deep learning-based CAD schemes for the detection and classification of lung nodules from CT images: A survey.

BACKGROUND Lung cancer is one of the most common diseases in the world. Computed tomography (CT) is the standard medical modality for early lung nodule detection and diagnosis that improves patient's survival rate. Recently, deep learning algorithms, especially convolutional neural networks (CNNs), have become a preferred methodology for developing computer-aided detection and diagnosis (CAD) schemes of lung CT images. OBJECTIVE Several CNN-based research projects have been initiated to design robust and efficient CAD schemes for the detection and classification of lung nodules. This paper reviews the recent works in this area and gives an insight into technical progress. METHODS First, a brief overview of CNN models and their basic structures is presented in this investigation. Then, we provide an analytic comparison of the existing approaches to discover recent trend and upcoming challenges. We also introduce an objective description of both handcrafted and deep learning features, as well as the types of nodules, the medical imaging modalities, the widely used databases, and related works in the last three years. The articles presented in this work were selected from various databases. About 57% of reviewed articles published in the last year. RESULTS Our analysis reveals that several methods achieved promising performance with high sensitivity rates ranging from 66% to 100% under the false-positive rates ranging from 1 to 15 per CT scan. It can be noted that CNN models have contributed to the accurate detection and early diagnosis of lung nodules. CONCLUSIONS From the critical discussion and an outline for prospective directions, this survey provide researchers valuable information to master the deep learning concepts and to deepen their knowledge of the trend and latest techniques in developing CAD schemes of lung CT images.

[1]  Aimin Hao,et al.  Hybrid-feature-guided lung nodule type classification on CT images , 2018, Comput. Graph..

[2]  Anselmo Cardoso de Paiva,et al.  Convolutional neural network-based PSO for lung nodule false positive reduction on CT images , 2018, Comput. Methods Programs Biomed..

[3]  João Manuel R. S. Tavares,et al.  Automatic 3D pulmonary nodule detection in CT images: A survey , 2016, Comput. Methods Programs Biomed..

[4]  Hyojin Kim,et al.  Lung nodule detection using 3D convolutional neural networks trained on weakly labeled data , 2016, SPIE Medical Imaging.

[5]  Stephen Lam,et al.  Computed Tomography and the Secrets of Lung Nodules , 2015, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[6]  Lisheng Xu,et al.  Segmentation of lung parenchyma in CT images using CNN trained with the clustering algorithm generated dataset , 2019, BioMedical Engineering OnLine.

[7]  Wenqing Sun,et al.  Fast and fully-automated detection and segmentation of pulmonary nodules in thoracic CT scans using deep convolutional neural networks , 2019, Comput. Medical Imaging Graph..

[8]  Berkman Sahiner,et al.  3D convolutional neural network for automatic detection of lung nodules in chest CT , 2017, Medical Imaging.

[9]  Taco S Cohen,et al.  Pulmonary nodule detection in CT scans with equivariant CNNs , 2019, Medical Image Anal..

[10]  Chaofeng Li,et al.  False-Positive Reduction on Lung Nodules Detection in Chest Radiographs by Ensemble of Convolutional Neural Networks , 2018, IEEE Access.

[11]  Tomohiro Kuroda,et al.  Computer-aided diagnosis of lung nodule using gradient tree boosting and Bayesian optimization , 2017, PloS one.

[12]  Aydin Kaya,et al.  Cascaded classifiers and stacking methods for classification of pulmonary nodule characteristics , 2018, Comput. Methods Programs Biomed..

[13]  Ilaria Gori,et al.  Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study , 2010, Medical Image Anal..

[14]  M. Skalski,et al.  The utilisation of convolutional neural networks in detecting pulmonary nodules: a review. , 2018, The British journal of radiology.

[15]  E. V. van Beek,et al.  The Lung Image Database Consortium (LIDC): a comparison of different size metrics for pulmonary nodule measurements. , 2007, Academic radiology.

[16]  Hiroshi Fujita,et al.  Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. , 2016, Medical physics.

[17]  Aurélio Campilho,et al.  Detection of juxta-pleural lung nodules in computed tomography images , 2017, Medical Imaging.

[18]  Shiqian Ma,et al.  Highly accurate model for prediction of lung nodule malignancy with CT scans , 2018, Scientific Reports.

[19]  Tingting Zhao,et al.  A hybrid CNN feature model for pulmonary nodule malignancy risk differentiation. , 2017, Journal of X-ray science and technology.

[20]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[21]  Junfeng Chen,et al.  3D skeletonization feature based computer-aided detection system for pulmonary nodules in CT datasets , 2018, Comput. Biol. Medicine.

[22]  Nima Tajbakhsh,et al.  Comparing two classes of end-to-end machine-learning models in lung nodule detection and classification: MTANNs vs. CNNs , 2017, Pattern Recognit..

[23]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[24]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Qi Liu,et al.  Automatic nodule detection for lung cancer in CT images: A review , 2018, Comput. Biol. Medicine.

[27]  Anup K. Sadhu,et al.  Lung Nodule Detection from Feature Engineering to Deep Learning in Thoracic CT Images: a Comprehensive Review , 2020, Journal of Digital Imaging.

[28]  Syed Omer Gilani,et al.  An appraisal of nodules detection techniques for lung cancer in CT images , 2018, Biomed. Signal Process. Control..

[29]  Peng Li,et al.  Evolving the pulmonary nodules diagnosis from classical approaches to deep learning-aided decision support: three decades’ development course and future prospect , 2019, Journal of Cancer Research and Clinical Oncology.

[30]  Bin Zheng,et al.  Automatic detection of pulmonary nodules in CT images by incorporating 3D tensor filtering with local image feature analysis. , 2018, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[31]  Shouliang Qi,et al.  Detection and Classification of Pulmonary Nodules Using Convolutional Neural Networks: A Survey , 2019, IEEE Access.

[32]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[33]  Nawres Khlifa,et al.  Multi-objectives optimisation of features selection for the classification of thyroid nodules in ultrasound images , 2020, IET Image Process..

[34]  Shouliang Qi,et al.  Ensemble Learning of Multiple-View 3D-CNNs Model for Micro-Nodules Identification in CT Images , 2019, IEEE Access.

[35]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[36]  Ping Li,et al.  Automated Decision Support System for Lung Cancer Detection and Classification via Enhanced RFCN With Multilayer Fusion RPN , 2020, IEEE Transactions on Industrial Informatics.

[37]  Xiaomei Ma,et al.  Lung Nodule Detection via Deep Reinforcement Learning , 2018, Front. Oncol..

[38]  He Ma,et al.  Lung nodule classification using local kernel regression models with out-of-sample extension , 2018, Biomed. Signal Process. Control..

[39]  Kenji Suzuki,et al.  Overview of deep learning in medical imaging , 2017, Radiological Physics and Technology.

[40]  Guixia Kang,et al.  3D multi-view convolutional neural networks for lung nodule classification , 2017, PloS one.

[41]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[42]  Bin Sheng,et al.  Computer-Assisted Decision Support System in Pulmonary Cancer detection and stage classification on CT images , 2018, J. Biomed. Informatics.

[43]  Ananda S. Chowdhury,et al.  A deep learning-shape driven level set synergism for pulmonary nodule segmentation , 2019, Pattern Recognit. Lett..

[44]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[45]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Shouliang Qi,et al.  Deep CNN models for pulmonary nodule classification: model modification, model integration, and transfer learning. , 2019, Journal of X-ray science and technology.

[47]  Yannick Le Moullec,et al.  Automatic detection of multisize pulmonary nodules in CT images: Large‐scale validation of the false‐positive reduction step , 2018, Medical physics.

[48]  Jason Cong,et al.  An automated lung segmentation approach using bidirectional chain codes to improve nodule detection accuracy , 2015, Comput. Biol. Medicine.

[49]  Ping He,et al.  An Appraisal of Lung Nodules Automatic Classification Algorithms for CT Images , 2019, Sensors.

[50]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..