Expert knowledge-infused deep learning for automatic lung nodule detection.

BACKGROUND Computer aided detection (CADe) of pulmonary nodules from computed tomography (CT) is crucial for early diagnosis of lung cancer. Self-learned features obtained by training datasets via deep learning have facilitated CADe of the nodules. However, the complexity of CT lung images renders a challenge of extracting effective features by self-learning only. This condition is exacerbated for limited size of datasets. On the other hand, the engineered features have been widely studied. OBJECTIVE We proposed a novel nodule CADe which aims to relieve the challenge by the use of available engineered features to prevent convolution neural networks (CNN) from overfitting under dataset limitation and reduce the running-time complexity of self-learning. METHODS The CADe methodology infuses adequately the engineered features, particularly texture features, into the deep learning process. RESULTS The methodology was validated on 208 patients with at least one juxta-pleural nodule from the public LIDC-IDRI database. Results demonstrated that the methodology achieves a sensitivity of 88% with 1.9 false positives per scan and a sensitivity of 94.01% with 4.01 false positives per scan. CONCLUSIONS The methodology shows high performance compared with the state-of-the-art results, in terms of accuracy and efficiency, from both existing CNN-based approaches and engineered feature-based classifications.

[1]  Shouhua Luo,et al.  Auto Diagnostics of Lung Nodules Using Minimal Characteristics Extraction Technique , 2016, Diagnostics.

[2]  Ilaria Gori,et al.  Combination of computer-aided detection algorithms for automatic lung nodule identification , 2011, International Journal of Computer Assisted Radiology and Surgery.

[3]  C E Ravin,et al.  Effects of image processing on nodule detection rates in digitized chest radiographs: ROC study of observer performance. , 1988, Radiology.

[4]  Donato Cascio,et al.  Automatic detection of lung nodules in CT datasets based on stable 3D mass-spring models , 2012, Comput. Biol. Medicine.

[5]  Zhengrong Liang,et al.  Texture Feature Extraction and Analysis for Polyp Differentiation via Computed Tomography Colonography , 2016, IEEE Transactions on Medical Imaging.

[6]  M. Giger,et al.  Image feature analysis and computer-aided diagnosis in digital radiography. 3. Automated detection of nodules in peripheral lung fields. , 1988, Medical physics.

[7]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[8]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Zhengrong Liang,et al.  Fast and Adaptive Detection of Pulmonary Nodules in Thoracic CT Images Using a Hierarchical Vector Quantization Scheme , 2015, IEEE Journal of Biomedical and Health Informatics.

[10]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[11]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[12]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[13]  Tingting Zhao,et al.  A hybrid CNN feature model for pulmonary nodule malignancy risk differentiation. , 2017, Journal of X-ray science and technology.

[14]  He Ma,et al.  An Automatic Detection System of Lung Nodule Based on Multigroup Patch-Based Deep Learning Network , 2018, IEEE Journal of Biomedical and Health Informatics.

[15]  Jan Cornelis,et al.  A novel computer-aided lung nodule detection system for CT images. , 2011, Medical physics.

[16]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[17]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[18]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[19]  Zhengrong Liang,et al.  A Fast Automatic Juxta-pleural Lung Nodule Detection Framework Using Convolutional Neural Networks and Vote Algorithm , 2018, Patch-MI@MICCAI.

[20]  Joyoni Dey,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[21]  Hyojin Kim,et al.  Lung nodule detection using 3D convolutional neural networks trained on weakly labeled data , 2016, SPIE Medical Imaging.

[22]  Nima Tajbakhsh,et al.  Comparing two classes of end-to-end machine-learning models in lung nodule detection and classification: MTANNs vs. CNNs , 2017, Pattern Recognit..

[23]  S. Armato,et al.  Computerized detection of pulmonary nodules on CT scans. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[24]  Tae-Sun Choi,et al.  Automated pulmonary nodule detection based on three-dimensional shape-based feature descriptor , 2014, Comput. Methods Programs Biomed..

[25]  Aybars Ugur,et al.  Shape and Texture Based Novel Features for Automated Juxtapleural Nodule Detection in Lung CTs , 2015, Journal of Medical Systems.

[26]  Nitish Srivastava,et al.  Exploiting Image-trained CNN Architectures for Unconstrained Video Classification , 2015, BMVC.

[27]  Hiroshi Fujita,et al.  Automated detection of pulmonary nodules in PET/CT images: Ensemble false-positive reduction using a convolutional neural network technique. , 2016, Medical physics.

[28]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[30]  Anselmo Cardoso de Paiva,et al.  Automatic detection of small lung nodules in 3D CT data using Gaussian mixture models, Tsallis entropy and SVM , 2014, Eng. Appl. Artif. Intell..

[31]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[32]  Hong Zhao,et al.  Texture Feature Analysis for Computer-Aided Diagnosis on Pulmonary Nodules , 2015, Journal of Digital Imaging.