Detection and classification of lung nodules in chest X‐ray images using deep convolutional neural networks

Lung nodule classification is one of the main topics related to computer‐aided detection systems. Although convolutional neural networks (CNNs) have been demonstrated to perform well on many tasks, there are few explorations of their use for classifying lung nodules in chest X‐ray (CXR) images. In this work, we proposed and analyzed a pipeline for detecting lung nodules in CXR images that includes lung area segmentation, potential nodule localization, and nodule candidate classification. We presented a method for classifying nodule candidates with a CNN trained from the scratch. The effectiveness of our method relies on the selection of data augmentation parameters, the design of a specialized CNN architecture, the use of dropout regularization on the network, inclusive in convolutional layers, and addressing the lack of nodule samples compared to background samples balancing mini‐batches on each stochastic gradient descent iteration. All model selection decisions were taken using a CXR subset of the Lung Image Database Consortium and Image Database Resource Initiative dataset separately. Thus, we used all images with nodules in the Japanese Society of Radiological Technology dataset for evaluation. Our experiments showed that CNNs were capable of achieving competitive results when compared to state‐of‐the‐art methods. Our proposal obtained an area under the free‐response receiver operating characteristic curve of 7.76 considering 10 false positives per image (FPPI), and sensitivity values of 73.1% and 79.6% with 2 and 5 FPPI, respectively.

[1]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[2]  Tao Wang,et al.  End-to-end text recognition with convolutional neural networks , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[3]  Guido Valli,et al.  Neural networks for computer-aided diagnosis: detection of lung nodules in chest radiograms , 2003, IEEE Transactions on Information Technology in Biomedicine.

[4]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[5]  Benjamin Graham,et al.  Spatially-sparse convolutional neural networks , 2014, ArXiv.

[6]  Stefanos Zafeiriou,et al.  A Unified Framework for Compositional Fitting of Active Appearance Models , 2016, International Journal of Computer Vision.

[7]  Ben Graham,et al.  Sparse 3D convolutional neural networks , 2015, BMVC.

[8]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[9]  Gábor Horváth,et al.  Kernel descriptors for chest x-ray analysis , 2017, Medical Imaging.

[10]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[11]  Hidefumi Kobatake,et al.  Convergence index filter for vector fields , 1999, IEEE Trans. Image Process..

[12]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[13]  Oscar Cordón,et al.  A survey on image segmentation using metaheuristic-based deformable models: state of the art and critical analysis , 2016, Appl. Soft Comput..

[14]  Elena Casiraghi,et al.  A Fully Automated Method for Lung Nodule Detection From Postero-Anterior Chest Radiographs , 2006, IEEE Transactions on Medical Imaging.

[15]  Kenji Suzuki,et al.  Computerized Detection of Lung Nodules by Means of “Virtual Dual-Energy” Radiography , 2013, IEEE Transactions on Biomedical Engineering.

[16]  Jane C. Carlon,et al.  Fundamentals of Diagnostic Radiology , 1994 .

[17]  Boris Polyak Some methods of speeding up the convergence of iteration methods , 1964 .

[18]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[19]  Hao Wang,et al.  Automatic Configuration of Deep Neural Networks with EGO , 2018, ArXiv.

[20]  Matthew T. Freedman,et al.  Reduction of false positives in lung nodule detection using a two-level neural classification , 1996, IEEE Trans. Medical Imaging.

[21]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[22]  Qingmao Hu,et al.  Lung nodule classification using deep feature fusion in chest radiography , 2017, Comput. Medical Imaging Graph..

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Xiao-Li Meng,et al.  The Art of Data Augmentation , 2001 .

[25]  Russell C. Hardie,et al.  Performance analysis of a new computer aided detection system for identifying lung nodules on chest radiographs , 2008, Medical Image Anal..

[26]  Tony Lindeberg,et al.  Image Matching Using Generalized Scale-Space Interest Points , 2013, Journal of Mathematical Imaging and Vision.

[27]  Maja Pantic,et al.  Gauss-Newton Deformable Part Models for Face Alignment In-the-Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Hidefumi Kobatake,et al.  Detection of cancerous tumors on chest X-ray images -candidate detection filter and its evaluation , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[29]  Anil K. Jain,et al.  Deformable template models: A review , 1998, Signal Process..

[30]  Matthew T. Freedman,et al.  Artificial convolution neural network techniques and applications for lung nodule detection , 1995, IEEE Trans. Medical Imaging.

[31]  Masanori Suganuma,et al.  A genetic programming approach to designing convolutional neural network architectures , 2017, GECCO.

[32]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[33]  G. Colditz,et al.  Online Continuing Education Activity Article Title: American Cancer Society Lung Cancer Screening Guidelines Continuing Medical Education Accreditation and Designation Statement: Continuing Nursing Education Accreditation and Designation Statement: Educational Objectives: Activity Disclosures Acs Co , 2022 .

[34]  Min Chen,et al.  Deep Learning for Imbalanced Multimedia Data Classification , 2015, 2015 IEEE International Symposium on Multimedia (ISM).

[35]  M. Plummer,et al.  International agency for research on cancer. , 2020, Archives of pathology.

[36]  S. McGuire World Cancer Report 2014. Geneva, Switzerland: World Health Organization, International Agency for Research on Cancer, WHO Press, 2015. , 2016, Advances in nutrition.

[37]  José Ranilla,et al.  Particle swarm optimization for hyper-parameter selection in deep neural networks , 2017, GECCO.

[38]  K. Doi,et al.  Computer-aided diagnostic scheme for the detection of lung nodules on chest radiographs: localized search method based on anatomical classification. , 2006, Medical physics.

[39]  Gábor Horváth,et al.  Algorithm fusion to improve detection of lung cancer on chest radiographs , 2012, Int. J. Intell. Comput. Cybern..

[40]  Timothy F. Cootes,et al.  Training Models of Shape from Sets of Examples , 1992, BMVC.

[41]  Bram van Ginneken,et al.  A computer-aided diagnosis system for detection of lung nodules in chest radiographs with an evaluation on a public database , 2006, Medical Image Anal..

[42]  E. V. van Beek,et al.  Lung cancer screening: Computed tomography or chest radiographs? , 2015, World journal of radiology.

[43]  Xiaodong Gu,et al.  Towards dropout training for convolutional neural networks , 2015, Neural Networks.

[44]  Bram van Ginneken,et al.  Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database , 2006, Medical Image Anal..

[45]  Klaus L. Irion,et al.  The calcified lung nodule: What does it mean? , 2010, Annals of thoracic medicine.

[46]  Carlos S. Pereira,et al.  Detection of Lung Nodule Candidates in Chest Radiographs , 2007, IbPRIA.

[47]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[48]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[49]  Hélio Pedrini,et al.  Lung Nodule Classification Based on Deep Convolutional Neural Networks , 2016, CIARP.

[50]  Kenneth O. Stanley,et al.  Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning , 2017, ArXiv.

[51]  Heber MacMahon,et al.  Development and evaluation of a computer-aided diagnostic scheme for lung nodule detection in chest radiographs by means of two-stage nodule enhancement with support vector classification. , 2011, Medical physics.

[52]  P. Brennan,et al.  A review of lung cancer screening and the role of computer-aided detection. , 2017, Clinical radiology.

[53]  Kunio Doi,et al.  Computer-aided diagnosis in chest radiography , 2007, Comput. Medical Imaging Graph..

[54]  Riccardo Dini Università degli Studi di Pisa , 2006 .

[55]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[56]  Gustavo Carneiro,et al.  Fully Automated Segmentation Using Distance Regularised Level Set and Deep-Structured Learning and Inference , 2017, Deep Learning and Convolutional Neural Networks for Medical Image Computing.

[57]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[58]  Shandra Bipat,et al.  Computer-aided detection of small pulmonary nodules in chest radiographs: an observer study. , 2011, Academic radiology.

[59]  CordónÓscar,et al.  A survey on image segmentation using metaheuristic-based deformable models , 2016 .

[60]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[61]  K. Doi,et al.  Optimal image feature set for detecting lung nodules on chest X-ray images , 2002 .

[62]  Ronald M. Summers,et al.  Machine learning and radiology , 2012, Medical Image Anal..

[63]  Ronald M. Summers Deep Learning and Computer-Aided Diagnosis for Medical Image Processing: A Personal Perspective , 2017, Deep Learning and Convolutional Neural Networks for Medical Image Computing.

[64]  Surya Ganguli,et al.  Exact solutions to the nonlinear dynamics of learning in deep linear neural networks , 2013, ICLR.