Segmentation and Image Analysis of Abnormal Lungs at CT: Current Approaches, Challenges, and Future Trends.

The computer-based process of identifying the boundaries of lung from surrounding thoracic tissue on computed tomographic (CT) images, which is called segmentation, is a vital first step in radiologic pulmonary image analysis. Many algorithms and software platforms provide image segmentation routines for quantification of lung abnormalities; however, nearly all of the current image segmentation approaches apply well only if the lungs exhibit minimal or no pathologic conditions. When moderate to high amounts of disease or abnormalities with a challenging shape or appearance exist in the lungs, computer-aided detection systems may be highly likely to fail to depict those abnormal regions because of inaccurate segmentation methods. In particular, abnormalities such as pleural effusions, consolidations, and masses often cause inaccurate lung segmentation, which greatly limits the use of image processing methods in clinical and research contexts. In this review, a critical summary of the current methods for lung segmentation on CT images is provided, with special emphasis on the accuracy and performance of the methods in cases with abnormalities and cases with exemplary pathologic findings. The currently available segmentation methods can be divided into five major classes: (a) thresholding-based, (b) region-based, (c) shape-based, (d) neighboring anatomy-guided, and (e) machine learning-based methods. The feasibility of each class and its shortcomings are explained and illustrated with the most common lung abnormalities observed on CT images. In an overview, practical applications and evolving technologies combining the presented approaches for the practicing radiologist are detailed.

[1]  Milan Sonka,et al.  Segmentation of pathological and diseased lung tissue in CT images using a graph-search algorithm , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  Ye Xu,et al.  MDCT-based 3-D texture classification of emphysema and early smoking related lung pathologies , 2006, IEEE Transactions on Medical Imaging.

[3]  Qiang Li,et al.  Automated segmentation of lungs with severe interstitial lung disease in CT. , 2009, Medical physics.

[4]  E. V. van Beek,et al.  The Lung Image Database Consortium (LIDC): a comparison of different size metrics for pulmonary nodule measurements. , 2007, Academic radiology.

[5]  Les R Folio,et al.  Consistency and efficiency of CT analysis of metastatic disease: semiautomated lesion management application within a PACS. , 2013, AJR. American journal of roentgenology.

[6]  D. Mollura,et al.  Recombinant human factor VIIa for alveolar hemorrhage following allogeneic stem cell transplantation. , 2014, Biology of blood and marrow transplantation : journal of the American Society for Blood and Marrow Transplantation.

[7]  D. Mollura,et al.  Computer-aided diagnosis of pulmonary infections using texture analysis and support vector machine classification. , 2011, Academic radiology.

[8]  Bram van Ginneken,et al.  Toward automated segmentation of the pathological lung in CT , 2005, IEEE Transactions on Medical Imaging.

[9]  T. Poggio,et al.  Vision: are models of object recognition catching up with the brain? , 2013, Annals of the New York Academy of Sciences.

[10]  Computerized analysis of mesothelioma on CT scans. , 2005, Lung cancer.

[11]  Karen Drukker,et al.  Automated detection of lung nodules in CT scans: false-positive reduction with the radial-gradient index. , 2006, Medical physics.

[12]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[13]  E. Kazerooni,et al.  Automated iterative neutrosophic lung segmentation for image analysis in thoracic computed tomography. , 2013, Medical physics.

[14]  K. Awai,et al.  Pulmonary nodules at chest CT: effect of computer-aided diagnosis on radiologists' detection performance. , 2004, Radiology.

[15]  Margrit Betke,et al.  Chest CT: automated nodule detection and assessment of change over time--preliminary experience. , 2001, Radiology.

[16]  Michael F. McNitt-Gray,et al.  Method for segmenting chest CT image data using an anatomical model: preliminary results , 1997, IEEE Transactions on Medical Imaging.

[17]  Ulas Bagci,et al.  Monitoring pulmonary fibrosis by fusing clinical, physiological, and computed tomography features , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Geoffrey McLennan,et al.  Establishing a normative atlas of the human lung: intersubject warping and registration of volumetric CT images. , 2003, Academic radiology.

[19]  Supun Samarasekera,et al.  Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 1996, CVGIP Graph. Model. Image Process..

[20]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[21]  Bram van Ginneken,et al.  Automated segmentation of pulmonary structures in thoracic computed tomography scans: a review , 2013 .

[22]  Jayaram K. Udupa,et al.  A framework for evaluating image segmentation algorithms , 2006, Comput. Medical Imaging Graph..

[23]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  David Dagan Feng,et al.  Automated localization and segmentation of lung tumor from PET-CT thorax volumes based on image feature analysis , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  G J Kemerink,et al.  On segmentation of lung parenchyma in quantitative computed tomography of the lung. , 1998, Medical physics.

[26]  Lena Costaridou,et al.  Texture-Based Identification and Characterization of Interstitial Pneumonia Patterns in Lung Multidetector CT , 2010, IEEE Transactions on Information Technology in Biomedicine.

[27]  Andreas Christe,et al.  Volumetric analysis of lung nodules in computed tomography (CT): comparison of two different segmentation algorithm softwares and two different reconstruction filters on automated volume calculation , 2014, Acta radiologica.

[28]  Josef Kittler,et al.  Region growing: a new approach , 1998, IEEE Trans. Image Process..

[29]  Jayaram K. Udupa,et al.  A Generic Approach to Pathological Lung Segmentation , 2014, IEEE Transactions on Medical Imaging.

[30]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Bram van Ginneken,et al.  Lung field segmentation from thin-slice CT scans in presence of severe pathology , 2004, SPIE Medical Imaging.

[33]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[34]  Albert Wu,et al.  Automatic Detection and Quantification of Tree-in-Bud (TIB) Opacities from CT Scans , 2012, IEEE Transactions on Biomedical Engineering.

[35]  Ross T. Whitaker,et al.  Partitioning 3D Surface Meshes Using Watershed Segmentation , 1999, IEEE Trans. Vis. Comput. Graph..

[36]  Ronald M. Summers,et al.  Automatic Segmentation and Measurement of Pleural Effusions on CT , 2013, IEEE Transactions on Biomedical Engineering.

[37]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[38]  Arunabha S. Roy,et al.  Automated lung nodule classification following automated nodule detection on CT: a serial approach. , 2003, Medical physics.

[39]  Ulas Bagci,et al.  Automated computer quantification of breast cancer in small-animal models using PET-guided MR image co-segmentation , 2013, EJNMMI Research.

[40]  Brendan Hogan,et al.  Significant savings in radiologic report turnaround time after implementation of a complete picture archiving and communication system (PACS) , 2009, Journal of Digital Imaging.

[41]  Marie-Pierre Jolly,et al.  Interactive Organ Segmentation Using Graph Cuts , 2000, MICCAI.

[42]  Ulas Bagci,et al.  A computational pipeline for quantification of pulmonary infections in small animal models using serial PET-CT imaging , 2013, EJNMMI Research.

[43]  Ulas Bagci,et al.  Learning Shape and Texture Characteristics of CT Tree-in-Bud Opacities for CAD Systems , 2011, MICCAI.

[44]  Alain Trémeau,et al.  A region growing and merging algorithm to color segmentation , 1997, Pattern Recognit..

[45]  Milan Sonka,et al.  Image processing analysis and machine vision [2nd ed.] , 1999 .

[46]  Geoffrey D. Rubin,et al.  Adaptive border marching algorithm: Automatic lung segmentation on chest CT images , 2008, Comput. Medical Imaging Graph..

[47]  Samuel G Armato Image annotation for conveying automated lung nodule detection results to radiologists. , 2003, Academic radiology.

[48]  Xinjian Chen,et al.  Medical Image Segmentation by Combining Graph Cuts and Oriented Active Appearance Models , 2012, IEEE Transactions on Image Processing.

[49]  Ulas Bagci,et al.  Automatic detection of tree-in-bud patterns for computer assisted diagnosis of respiratory tract infections , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[50]  Nico Karssemeijer,et al.  Computer-Aided Diagnosis in Medical Imaging , 2001, IEEE Trans. Medical Imaging.

[51]  D Marr,et al.  Bandpass channels, zero-crossings, and early visual information processing. , 1979, Journal of the Optical Society of America.

[52]  Hee Chan Kim,et al.  Computer-aided diagnosis of solid breast nodules: use of an artificial neural network based on multiple sonographic features , 2004, IEEE Trans. Medical Imaging.

[53]  Albert Wu,et al.  Automatic quantification of Tree-in-Bud patterns from CT scans , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[54]  Stefano Diciotti,et al.  Automated Segmentation Refinement of Small Lung Nodules in CT Scans by Local Shape Analysis , 2011, IEEE Transactions on Biomedical Engineering.

[55]  Ulas Bagci,et al.  Spatially Constrained Random Walk Approach for Accurate Estimation of Airway Wall Surfaces , 2013, MICCAI.

[56]  N. Müller,et al.  Fleischner Society: glossary of terms for thoracic imaging. , 2008, Radiology.

[57]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[58]  David Dagan Feng,et al.  Feature-Based Image Patch Approximation for Lung Tissue Classification , 2013, IEEE Transactions on Medical Imaging.

[59]  Sanjay Jain,et al.  Computer-aided detection and quantification of cavitary tuberculosis from CT scans. , 2013, Medical physics.

[60]  Reinhard Beichel,et al.  Automated 3-D Segmentation of Lungs With Lung Cancer in CT Data Using a Novel Robust Active Shape Model Approach , 2012, IEEE Transactions on Medical Imaging.

[61]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  Xinjian Chen,et al.  Hierarchical Scale-Based Multiobject Recognition of 3-D Anatomical Structures , 2012, IEEE Transactions on Medical Imaging.

[63]  S. Armato,et al.  Automated lung segmentation for thoracic CT impact on computer-aided diagnosis. , 2004, Academic radiology.

[64]  Joseph M. Reinhardt,et al.  3D pulmonary CT image registration with a standard lung atlas , 2000, Medical Imaging.

[65]  Bram van Ginneken,et al.  Computer analysis of computed tomography scans of the lung: a survey , 2006, IEEE Transactions on Medical Imaging.

[66]  Heber MacMahon,et al.  Evaluation of semiautomated measurements of mesothelioma tumor thickness on CT scans. , 2005, Academic radiology.

[67]  Ulas Bagci,et al.  Computer-assisted detection of infectious lung diseases: A review , 2012, Comput. Medical Imaging Graph..