Automatic Pulmonary Artery and Vein Separation Algorithm Based on Multitask Classification Network and Topology Reconstruction in Chest CT Images

With the development of medical computeraided diagnostic systems, pulmonary artery-vein(A/V) reconstruction plays a crucial role in assisting doctors in preoperative planning for lung cancer surgery. However, distinguishing arterial from venous irrigation in chest CT images remains a challenge due to the similarity and complex structure of the arteries and veins. We propose a novel method for automatic separation of pulmonary arteries and veins from chest CT images. The method consists of three parts. First, global connection information and local feature information are used to construct a complete topological tree and ensure the continuity of vessel reconstruction. Second, the multitask classification network proposed can automatically learn the differences between arteries and veins at different scales to reduce classification errors caused by changes in terminal vessel characteristics. Finally, the topology optimizer considers interbranch and intrabranch topological relationships to maintain spatial consistency to avoid the misclassification of A/V irrigations. We validate the performance of the method on chest CT images. Compared with manual classification, the proposed method achieves an average accuracy of 96.2% on noncontrast chest CT. In addition, the method has been proven to have good generalization, that is, the accuracies of 93.8% and 94.8% are obtained for CT scans from other devices and other modes, respectively. The result of pulmonary artery-vein reconstruction obtained by the proposed method can provide better assistance for preoperative planning of lung cancer surgery.

[1]  Noboru Niki,et al.  Extraction and classification of pulmonary organs based on thoracic 3D CT images , 2001, Systems and Computers in Japan.

[2]  Hiroshi Ishikawa,et al.  Data-Dependent Higher-Order Clique Selection for Artery–Vein Segmentation by Energy Minimization , 2015, International Journal of Computer Vision.

[3]  Raúl San José Estépar,et al.  A graph‐cut approach for pulmonary artery‐vein segmentation in noncontrast CT images , 2019, Medical Image Anal..

[4]  Michael Pienn,et al.  Automatic Artery-Vein Separation from Thoracic CT Images Using Integer Programming , 2015, MICCAI.

[5]  Weidong Cai,et al.  Automated 3D Neuron Tracing with Precise Branch Erasing and Confidence Controlled Back-Tracking , 2017, bioRxiv.

[6]  Sang Min Lee,et al.  Automatic reconstruction of the arterial and venous trees on volumetric chest CT. , 2013, Medical physics.

[7]  Jaesung Lee,et al.  Automated segmentation of the pulmonary arteries in low-dose CT by vessel tracking , 2011, ArXiv.

[8]  Raúl San José Estépar,et al.  Pulmonary Artery–Vein Classification in CT Images Using Deep Learning , 2018, IEEE Transactions on Medical Imaging.

[9]  Xinglong Liu,et al.  Pulmonary Vessel Segmentation Based on Orthogonal Fused U-Net++ of Chest CT Images , 2019, MICCAI.

[10]  Guang-Zhong Yang,et al.  Learning Tubule-Sensitive CNNs for Pulmonary Airway and Artery-Vein Segmentation in CT , 2020, IEEE Transactions on Medical Imaging.

[11]  Punam K. Saha,et al.  A survey on skeletonization algorithms and their applications , 2016, Pattern Recognit. Lett..

[12]  Eva M. van Rikxoort,et al.  Automatic Pulmonary Artery-Vein Separation and Classification in Computed Tomography Using Tree Partitioning and Peripheral Vessel Matching , 2016, IEEE Transactions on Medical Imaging.

[13]  Attila Kuba,et al.  A Parallel 3D 12-Subiteration Thinning Algorithm , 1999, Graph. Model. Image Process..

[14]  Cristian Lorenz,et al.  Automatic extraction of the pulmonary artery tree from multi-slice CT data , 2005, SPIE Medical Imaging.

[16]  Milan Sonka,et al.  Topomorphologic Separation of Fused Isointensity Objects via Multiscale Opening: Separating Arteries and Veins in 3-D Pulmonary CT , 2010, IEEE Transactions on Medical Imaging.

[17]  Boudewijn P. F. Lelieveldt,et al.  Linking Convolutional Neural Networks with Graph Convolutional Networks: Application in Pulmonary Artery-Vein Separation , 2019, GLMI@MICCAI.

[18]  Thomas Schultz,et al.  Computational vascular morphometry for the assessment of pulmonary vascular disease based on scale-space particles , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[19]  R. Zheng,et al.  [Report of cancer epidemiology in China, 2015]. , 2019, Zhonghua zhong liu za zhi [Chinese journal of oncology].