Lung field segmentation in chest radiographs: a historical review, current status, and expectations from deep learning

Lung field defines a region-of-interest in which specific radiologic signs such as septal lines, pulmonary opacities, cavities, consolidations, and lung nodules are searched by a chest radiographic computer-aided diagnostic system. Thus, its precise segmentation is extremely important. To precisely segment it, numerous methods have been developed during the last four decades. However, no exclusive survey consolidating the advancements in these methods has been presented till date, thus indicating a void and the need. This study fills the void by presenting a comprehensive survey of these methods with a focus on their underlying principle, the dataset used, reported performance, and relative merits and demerits. It refrains from doing a hard comparative evaluation by bringing all of them on a common platform, since the datasets used in their development and testing are of varied quality, complexity, and are not publicly available. It also provides a glimpse of deep learning, the present state of deep-learning-based lung field segmentation methods, expectations from it, and the challenges ahead of it.

[1]  Keith A. Paton,et al.  Measurement of Pneumoconiosis by Computer , 1976, IEEE Transactions on Computers.

[2]  Matteo Bottai,et al.  Computer-aided recognition of emphysema on digital chest radiography. , 2011, European journal of radiology.

[3]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[4]  Zohair Al aseri,et al.  Accuracy of chest radiograph interpretation by emergency physicians , 2009, Emergency Radiology.

[5]  Yaozong Gao,et al.  Hierarchical Lung Field Segmentation With Joint Shape and Appearance Sparse Learning , 2014, IEEE Transactions on Medical Imaging.

[6]  Giuseppe Coppini,et al.  A computer-aided diagnosis approach for emphysema recognition in chest radiography. , 2013, Medical Engineering and Physics.

[7]  Suhuai Luo,et al.  Lung segmentation based on customized active shape model from digital radiography chest images , 2015 .

[8]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[9]  Heber MacMahon,et al.  Improved detection of focal pneumonia by chest radiography with bone suppression imaging , 2012, European Radiology.

[10]  Kenji Suzuki,et al.  Separation of Bones From Chest Radiographs by Means of Anatomically Specific Multiple Massive-Training ANNs Combined With Total Variation Minimization Smoothing , 2014, IEEE Transactions on Medical Imaging.

[11]  D. Mollura,et al.  Computer-aided diagnosis of pulmonary infections using texture analysis and support vector machine classification. , 2011, Academic radiology.

[12]  Ronald M. Summers,et al.  Machine learning and radiology , 2012, Medical Image Anal..

[13]  M S Brown,et al.  Knowledge-based method for segmentation and analysis of lung boundaries in chest X-ray images. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[14]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[15]  H. K. Huang,et al.  Feature selection in the pattern classification problem of digital chest radiograph segmentation , 1995, IEEE Trans. Medical Imaging.

[16]  K. Doi,et al.  Image feature analysis and computer-aided diagnosis in digital radiography: automated detection of pneumothorax in chest images. , 1992, Medical physics.

[17]  Wei Guo,et al.  Lung Fields Segmentation Algorithm in Chest Radiography , 2014, IGTA.

[18]  A. Ray,et al.  Lung Cancer Detection using Computer Aided Diagnosis in Chest Radiograph: A Survey and Analysis , 2005 .

[19]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[20]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[21]  K. Doi,et al.  Image feature analysis for computer-aided diagnosis: detection of right and left hemidiaphragm edges and delineation of lung field in chest radiographs. , 1996, Medical physics.

[22]  S K Mun,et al.  Automated segmentation of anatomic regions in chest radiographs using an adaptive-sized hybrid neural network. , 1998, Medical physics.

[23]  A. Ardeshir Goshtasby,et al.  Automatic detection of rib borders in chest radiographs , 1995, IEEE Trans. Medical Imaging.

[24]  S. Osher,et al.  Level set methods: an overview and some recent results , 2001 .

[25]  Ivo D. Dinov,et al.  Deep learning for neural networks , 2018 .

[26]  Alexandros Karargyris,et al.  Combination of texture and shape features to detect pulmonary abnormalities in digital chest X-rays , 2015, International Journal of Computer Assisted Radiology and Surgery.

[27]  B. Ginneken,et al.  Automatic segmentation of lung fields in chest radiographs. , 2000 .

[28]  Jerry L Prince,et al.  Image Segmentation Using Deformable Models , 2000 .

[29]  Tao Xu,et al.  An edge-region force guided active shape approach for automatic lung field detection in chest radiographs , 2012, Comput. Medical Imaging Graph..

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  M. Kallergi,et al.  Improved method for automatic identification of lung regions on chest radiographs. , 2001 .

[32]  Charles A. Laszlo,et al.  The Measurement of Total Lung Capacity Based on a Computer Analysis of Anterior and Lateral Radiographic Chest Images , 1974 .

[33]  Bruno Petinaux,et al.  Accuracy of radiographic readings in the emergency department. , 2011, The American journal of emergency medicine.

[34]  Kunio Doi,et al.  Small lung cancers: improved detection by use of bone suppression imaging--comparison with dual-energy subtraction chest radiography. , 2011, Radiology.

[35]  L. S. Broderick,et al.  Dual-energy subtraction chest radiography: what to look for beyond calcified nodules. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[36]  Shih-Chung Benedict Lo,et al.  Lung nodules: improved detection with software that suppresses the rib and clavicle on chest radiographs. , 2011, Radiology.

[37]  Ulas Bagci,et al.  Atlas-based rib-bone detection in chest X-rays , 2016, Comput. Medical Imaging Graph..

[38]  Bram van Ginneken,et al.  Automatic detection of pleural effusion in chest radiographs , 2016, Medical Image Anal..

[39]  Ronald M. Summers,et al.  Deep convolutional networks for pancreas segmentation in CT imaging , 2015, Medical Imaging.

[40]  G. Savino,et al.  Cardiac silhouette findings and mediastinal lines and stripes: radiograph and CT scan correlation. , 2011, Chest.

[41]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[42]  Noriyuki Tomiyama,et al.  Temporal subtraction for the detection of hazy pulmonary opacities on chest radiography. , 2002, AJR. American journal of roentgenology.

[43]  Hamid Reza Pourreza,et al.  Fully Automatic Lung Segmentation and Rib Suppression Methods to Improve Nodule Detection in Chest Radiographs , 2011, Journal of medical signals and sensors.

[44]  Trevor Darrell,et al.  Fully convolutional networks for semantic segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  M L Giger,et al.  Computerized delineation and analysis of costophrenic angles in digital chest radiographs. , 1998, Academic radiology.

[46]  Alejandro F. Frangi,et al.  Active shape model segmentation with optimal features , 2002, IEEE Transactions on Medical Imaging.

[47]  Bram van Ginneken,et al.  Automated localization of costophrenic recesses and costophrenic angle measurement on frontal chest radiographs , 2013, Medical Imaging.

[48]  S. Armato,et al.  Automated lung segmentation in digitized posteroanterior chest radiographs. , 1998, Academic radiology.

[49]  Ewa Pietka,et al.  Lung segmentation in digital radiographs , 1994, Journal of Digital Imaging.

[50]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[51]  Theo Gevers,et al.  A Spatially Constrained Generative Model and an EM Algorithm for Image Segmentation , 2007, IEEE Transactions on Neural Networks.

[52]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[53]  Ernest L. Hall,et al.  Texture Measures for Automatic Classification of Pulmonary Disease , 1972, IEEE Transactions on Computers.

[54]  Angel Cruz-Roa,et al.  Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features , 2014, Journal of medical imaging.

[55]  Sunil Arya,et al.  Approximate nearest neighbor queries in fixed dimensions , 1993, SODA '93.

[56]  C E Floyd,et al.  Markov random field modeling in posteroanterior chest radiograph segmentation. , 1999, Medical physics.

[57]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[58]  C. Floyd,et al.  Identification of lung regions in chest radiographs using Markov random field modeling. , 1998, Medical physics.

[59]  Ronald M. Summers,et al.  DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation , 2015, MICCAI.

[60]  Mohammad Faizal Ahmad Fauzi,et al.  Lung segmentation on standard and mobile chest radiographs using oriented Gaussian derivatives filter , 2015 .

[61]  Max A. Viergever,et al.  Computer-aided diagnosis in chest radiography: a survey , 2001, IEEE Transactions on Medical Imaging.

[62]  Bram van Ginneken,et al.  Segmentation of the posterior ribs in chest radiographs using iterated contextual pixel classification , 2006, IEEE Transactions on Medical Imaging.

[63]  Alexandros Karargyris,et al.  Automatically Detecting Rotation in Chest Radiographs Using Principal Rib-Orientation Measure for Quality Control , 2015, Int. J. Pattern Recognit. Artif. Intell..

[64]  Qingmao Hu,et al.  Automatic Lung Field Segmentation in X-ray Radiographs Using Statistical Shape and Appearance Models , 2016 .

[65]  Amer Dawoud,et al.  Lung segmentation in chest radiographs by fusing shape information in iterative thresholding , 2011 .

[66]  Dinggang Shen,et al.  Segmenting Lung Fields in Serial Chest Radiographs Using Both Population-Based and Patient-Specific Shape Statistics , 2008, IEEE Transactions on Medical Imaging.

[67]  J. Boone,et al.  A fully automated algorithm for the segmentation of lung fields on digital chest radiographic images. , 1995, Medical physics.

[68]  Bram van Ginneken,et al.  Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database , 2006, Medical Image Anal..

[69]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[70]  K. Doi,et al.  Image feature analysis and computer-aided diagnosis in digital radiography: automated analysis of sizes of heart and lung in chest images. , 1990, Medical physics.