Automated integer programming based separation of arteries and veins from thoracic CT images

Automated computer-aided analysis of lung vessels has shown to yield promising results for non-invasive diagnosis of lung diseases. To detect vascular changes which affect pulmonary arteries and veins differently, both compartments need to be identified. We present a novel, fully automatic method that separates arteries and veins in thoracic computed tomography images, by combining local as well as global properties of pulmonary vessels. We split the problem into two parts: the extraction of multiple distinct vessel subtrees, and their subsequent labeling into arteries and veins. Subtree extraction is performed with an integer program (IP), based on local vessel geometry. As naively solving this IP is time-consuming, we show how to drastically reduce computational effort by reformulating it as a Markov Random Field. Afterwards, each subtree is labeled as either arterial or venous by a second IP, using two anatomical properties of pulmonary vessels: the uniform distribution of arteries and veins, and the parallel configuration and close proximity of arteries and bronchi. We evaluate algorithm performance by comparing the results with 25 voxel-based manual reference segmentations. On this dataset, we show good performance of the subtree extraction, consisting of very few non-vascular structures (median value: 0.9%) and merged subtrees (median value: 0.6%). The resulting separation of arteries and veins achieves a median voxel-based overlap of 96.3% with the manual reference segmentations, outperforming a state-of-the-art interactive method. In conclusion, our novel approach provides an opportunity to become an integral part of computer aided pulmonary diagnosis, where artery/vein separation is important.

[1]  Hiroshi Ishikawa,et al.  Data-Dependent Higher-Order Clique Selection for Artery–Vein Segmentation by Energy Minimization , 2015, International Journal of Computer Vision.

[2]  J. Reinhardt,et al.  Automated Method for Identification and Artery-Venous Classification of Vessel Trees in Retinal Vessel Networks , 2014, PloS one.

[3]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[4]  Sang Min Lee,et al.  Automatic reconstruction of the arterial and venous trees on volumetric chest CT. , 2013, Medical physics.

[5]  Josep Roca,et al.  Enhanced expression of vascular endothelial growth factor in pulmonary arteries of smokers and patients with moderate chronic obstructive pulmonary disease. , 2003, American journal of respiratory and critical care medicine.

[6]  Paul Bresser,et al.  Chronic Thromboembolic Pulmonary Hypertension (CTEPH)Clinical Perspective , 2011 .

[7]  Bram van Ginneken,et al.  A large-scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification , 2009, Medical Image Anal..

[8]  Pascal Fua,et al.  Simultaneous Segmentation and Anatomical Labeling of the Cerebral Vasculature , 2014, MICCAI.

[9]  John J. Grefenstette,et al.  Comparing algorithms for large-scale sequence analysis , 2001, Proceedings 2nd Annual IEEE International Symposium on Bioinformatics and Bioengineering (BIBE 2001).

[10]  Kunio Doi,et al.  Computerized detection of pulmonary embolism in spiral CT angiography based on volumetric image analysis , 2002, IEEE Transactions on Medical Imaging.

[11]  Toshihiko Sugiura,et al.  Role of 320-slice CT imaging in the diagnostic workup of patients with chronic thromboembolic pulmonary hypertension. , 2013, Chest.

[12]  Nicholas Ayache,et al.  Model-Based Detection of Tubular Structures in 3D Images , 2000, Comput. Vis. Image Underst..

[13]  Isabelle Bloch,et al.  A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes , 2009, Medical Image Anal..

[14]  Gábor Székely,et al.  Reconstructing cerebrovascular networks under local physiological constraints by integer programming , 2015, Medical Image Anal..

[15]  Jayaram K. Udupa,et al.  Artery-vein separation via MRA-An image processing approach , 2001, IEEE Transactions on Medical Imaging.

[16]  Bram van Ginneken,et al.  Computer analysis of computed tomography scans of the lung: a survey , 2006, IEEE Transactions on Medical Imaging.

[17]  Milan Sonka,et al.  Topomorphologic Separation of Fused Isointensity Objects via Multiscale Opening: Separating Arteries and Veins in 3-D Pulmonary CT , 2010, IEEE Transactions on Medical Imaging.

[18]  L. Gouveia,et al.  Models and heuristics for a minimum arborescence problem , 2008 .

[19]  Keith McNeil,et al.  Chronic thromboembolic pulmonary hypertension (CTEPH) , 2007, Heart.

[20]  Franz Aurenhammer,et al.  Voronoi diagrams—a survey of a fundamental geometric data structure , 1991, CSUR.

[21]  Toru Satoh,et al.  Definitions and diagnosis of pulmonary hypertension. , 2013, Journal of the American College of Cardiology.

[22]  Bram van Ginneken,et al.  Automated segmentation of pulmonary structures in thoracic computed tomography scans: a review , 2013, Physics in medicine and biology.

[23]  Bogdan Savchynskyy,et al.  Maximum persistency via iterative relaxed inference with graphical models , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  M. Urschler,et al.  Quantification of Tortuosity and Fractal Dimension of the Lung Vessels in Pulmonary Hypertension Patients , 2014, PloS one.

[25]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[26]  Francis K. H. Quek,et al.  A review of vessel extraction techniques and algorithms , 2004, CSUR.

[27]  Örjan Smedby,et al.  Segmentation with gray‐scale connectedness can separate arteries and veins in MRA , 2002, Journal of magnetic resonance imaging : JMRI.

[28]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[29]  Gady Agam,et al.  Vessel tree reconstruction in thoracic CT scans with application to nodule detection , 2005, IEEE Transactions on Medical Imaging.

[30]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[31]  Raúl San José Estépar,et al.  Computed tomographic measures of pulmonary vascular morphology in smokers and their clinical implications. , 2013, American journal of respiratory and critical care medicine.

[32]  Cristian Lorenz,et al.  Automatic extraction of the pulmonary artery tree from multi-slice CT data , 2005, SPIE Medical Imaging.

[33]  D A Lynch,et al.  Endothelial cell death and decreased expression of vascular endothelial growth factor and vascular endothelial growth factor receptor 2 in emphysema. , 2001, American journal of respiratory and critical care medicine.

[34]  Christophe Duhamel,et al.  Models and heuristics for a minimum arborescence problem , 2008, Networks.

[35]  Alejandro F. Frangi,et al.  Model-based quantitation of 3-D magnetic resonance angiographic images , 1999, IEEE Transactions on Medical Imaging.

[36]  Raúl San José Estépar,et al.  Quantitative CT measurement of cross-sectional area of small pulmonary vessel in COPD: correlations with emphysema and airflow limitation. , 2010, Academic radiology.

[37]  Bram van Ginneken,et al.  Automated segmentation of pulmonary structures in thoracic computed tomography scans: a review , 2013 .

[38]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Alys R. Clark,et al.  Computational models of the pulmonary circulation: Insights and the move towards clinically directed studies , 2011, Pulmonary circulation.

[40]  Bennett A. Landman,et al.  Simultaneous segmentation and statistical label fusion , 2012, Medical Imaging.

[41]  Daphne Koller,et al.  A Fast and Exact Energy Minimization Algorithm for Cycle MRFs , 2013, ICML.

[42]  Chandrajit L. Bajaj,et al.  Artery-vein separation of human vasculature from 3D thoracic CT angio scans , 2006, CompIMAGE.

[43]  Eva M. van Rikxoort,et al.  Automatic Pulmonary Artery-Vein Separation and Classification in Computed Tomography Using Tree Partitioning and Peripheral Vessel Matching , 2016, IEEE Transactions on Medical Imaging.

[44]  Pascal Fua,et al.  Simultaneous segmentation and anatomical labeling of the cerebral vasculature , 2016, Medical Image Anal..

[45]  Heinz-Otto Peitgen,et al.  Determination of lung segments in computed tomography images using the Euclidean distance to the pulmonary artery. , 2013, Medical physics.

[46]  Valery Naranjo,et al.  Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study , 2014, Medical Image Anal..

[47]  Michael Pienn,et al.  Automatic Artery-Vein Separation from Thoracic CT Images Using Integer Programming , 2015, MICCAI.

[48]  Eric A. Hoffman,et al.  A New Paradigm of Interactive Artery/Vein Separation in Noncontrast Pulmonary CT Imaging Using Multiscale Topomorphologic Opening , 2012, IEEE Transactions on Biomedical Engineering.

[49]  Pascal Fua,et al.  Tubular Geodesics using Oriented Flux: An ITK Implementation , 2013 .

[50]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[51]  H. Ishikawa,et al.  Adaptive higher-order submodular potentials for pulmonary artery-vein segmentation , 2013 .

[52]  Raúl San José Estépar,et al.  Pulmonary hypertension and computed tomography measurement of small pulmonary vessels in severe emphysema. , 2010, American journal of respiratory and critical care medicine.

[53]  Lubomir M. Hadjiiski,et al.  Automatic multiscale enhancement and segmentation of pulmonary vessels in CT pulmonary angiography images for CAD applications. , 2007, Medical physics.

[54]  Pascal Fua,et al.  Reconstructing Loopy Curvilinear Structures Using Integer Programming , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  Matti Pietikäinen,et al.  Large-Scale Evaluation , 2009, Encyclopedia of Biometrics.

[56]  Max A. Viergever,et al.  Level-set-based artery-vein separation in blood pool agent CE-MR angiograms , 2003, IEEE Transactions on Medical Imaging.

[57]  伊藤 渡,et al.  Adaptive higher-order submodular potentials for pulmonary artery-vein segmentation , 2015 .

[58]  M. Gladwin,et al.  Segmentation and quantification of pulmonary artery for noninvasive CT assessment of sickle cell secondary pulmonary hypertension. , 2010, Medical physics.

[59]  Eric A. Hoffman,et al.  Automated Assessment of Pulmonary Arterial Morphology in Multi-row Detector CT Imaging Using Correspondence with Anatomic Airway Branches , 2014, ISVC.