Deep learning aided decision support for pulmonary nodules diagnosing: a review.

Deep learning techniques have recently emerged as promising decision supporting approaches to automatically analyze medical images for different clinical diagnosing purposes. Diagnosing of pulmonary nodules by using computer-assisted diagnosing has received considerable theoretical, computational, and empirical research work, and considerable methods have been developed for detection and classification of pulmonary nodules on different formats of images including chest radiographs, computed tomography (CT), and positron emission tomography in the past five decades. The recent remarkable and significant progress in deep learning for pulmonary nodules achieved in both academia and the industry has demonstrated that deep learning techniques seem to be promising alternative decision support schemes to effectively tackle the central issues in pulmonary nodules diagnosing, including feature extraction, nodule detection, false-positive reduction, and benign-malignant classification for the huge volume of chest scan data. The main goal of this investigation is to provide a comprehensive state-of-the-art review of the deep learning aided decision support for pulmonary nodules diagnosing. As far as the authors know, this is the first time that a review is devoted exclusively to deep learning techniques for pulmonary nodules diagnosing.

[1]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[2]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[3]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[4]  Mei Xie,et al.  Automatic Categorization and Scoring of Solid, Part-Solid and Non-Solid Pulmonary Nodules in CT Images with Convolutional Neural Network , 2017, Scientific Reports.

[5]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[8]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[9]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[10]  Lauge Sørensen,et al.  A Texton-Based Approach for the Classification of Lung Parenchyma in CT Images , 2010, MICCAI.

[11]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[12]  Nima Tajbakhsh,et al.  Comparing two classes of end-to-end machine-learning models in lung nodule detection and classification: MTANNs vs. CNNs , 2017, Pattern Recognit..

[13]  Bram van Ginneken,et al.  Fifty years of computer analysis in chest imaging: rule-based, machine learning, deep learning , 2017, Radiological Physics and Technology.

[14]  Bram van Ginneken,et al.  Towards automatic pulmonary nodule management in lung cancer screening with deep learning , 2016, Scientific Reports.

[15]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[16]  U. Costabel,et al.  ATS/ERS international multidisciplinary consensus classification of the idiopathic interstitial pneumonias , 2002, European Respiratory Journal.

[17]  Aimin Hao,et al.  Hybrid-feature-guided lung nodule type classification on CT images , 2018, Comput. Graph..

[18]  Wen-Huang Cheng,et al.  Computer-aided classification of lung nodules on computed tomography images via deep learning technique , 2015, OncoTargets and therapy.

[19]  Eliot L Siegel,et al.  Reinventing Radiology: Big Data and the Future of Medical Imaging , 2018, Journal of thoracic imaging.

[20]  João Manuel R. S. Tavares,et al.  Automatic 3D pulmonary nodule detection in CT images: A survey , 2016, Comput. Methods Programs Biomed..

[21]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[22]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[23]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[24]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[25]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[26]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[27]  Wenqing Sun,et al.  Automatic feature learning using multichannel ROI based on deep structured algorithms for computerized lung cancer diagnosis , 2017, Comput. Biol. Medicine.

[28]  Lauge Sørensen,et al.  Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns , 2010, IEEE Transactions on Medical Imaging.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  T. King.  Clinical advances in the diagnosis and therapy of the interstitial lung diseases. , 2005, American journal of respiratory and critical care medicine.

[31]  Hao Chen,et al.  Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge , 2016, Medical Image Anal..

[32]  A. Burgun,et al.  Big Data and machine learning in radiation oncology: State of the art and future prospects. , 2016, Cancer letters.

[33]  Geoffrey McLennan,et al.  WE‐B‐201B‐02: The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A Completed Public Database of CT Scans for Lung Nodule Analysis , 2010 .

[34]  Shuang Liu,et al.  Pulmonary nodule classification in lung cancer screening with three-dimensional convolutional neural networks , 2017, Journal of medical imaging.

[35]  Yanning Zhang,et al.  Fusing texture, shape and deep model-learned information at decision level for automated classification of lung nodules on chest CT , 2018, Inf. Fusion.

[36]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[37]  Hiroshi Fujita,et al.  Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. , 2016, Medical physics.

[38]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[39]  Marios Anthimopoulos,et al.  Classification of interstitial lung disease patterns using local DCT features and random forest , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.