A Deep learning Approach to Generate Contrast-Enhanced Computerised Tomography Angiography without the Use of Intravenous Contrast Agents

Contrast-enhanced computed tomography angiograms (CTAs) are widely used in cardiovascular imaging to obtain a non-invasive view of arterial structures. However, contrast agents are associated with complications at the injection site as well as renal toxicity leading to contrast-induced nephropathy (CIN) and renal failure. We hypothesised that the raw data acquired from a non-contrast CT contains sufficient information to differentiate blood and other soft tissue components. We utilised deep learning methods to define the subtleties between soft tissue components in order to simulate contrast enhanced CTAs without contrast agents. Twenty-six patients with paired non-contrast and CTA images were randomly selected from an approved clinical study. Non-contrast axial slices within the AAA from 10 patients (n = 100) were sampled for the underlying Hounsfield unit (HU) distribution at the lumen, intra-luminal thrombus and interface locations. Sampling of HUs in these regions revealed significant differences between all regions (p<0.001 for all comparisons), confirming the intrinsic differences in the radiomic signatures between these regions. To generate a large training dataset, paired axial slices from the training set (n=13) were augmented to produce a total of 23,551 2-D images. We trained a 2-D Cycle Generative Adversarial Network (cycleGAN) for this non-contrast to contrast (NC2C) transformation task. The accuracy of the cycleGAN output was assessed by comparison to the contrast image. This pipeline is able to differentiate between visually incoherent soft tissue regions in non-contrast CT images. The CTAs generated from the non-contrast images bear strong resemblance to the ground truth. Here we describe a novel application of Generative Adversarial Network for CT image processing. This is poised to disrupt clinical pathways requiring contrast enhanced CT imaging.

[1]  M. Karçaaltıncaba,et al.  Computed Tomography Angiography: Principles and Clinical Applications , 2003, Journal of computer assisted tomography.

[2]  J. Powell,et al.  The role of diameter versus volume as the best prognostic measurement of abdominal aortic aneurysms. , 2013, Journal of vascular surgery.

[3]  Zhonghua Sun,et al.  Coronary CT angiography: current status and continuing challenges. , 2012, The British journal of radiology.

[4]  M I Miller,et al.  Mathematical textbook of deformable neuroanatomies. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Pedro Costa,et al.  Towards Adversarial Retinal Image Synthesis , 2017, ArXiv.

[6]  Snehashis Roy,et al.  Magnetic resonance image synthesis through patch regression , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[7]  Elliot K Fishman,et al.  Risk of Acute Kidney Injury After Intravenous Contrast Media Administration , 2017, Annals of emergency medicine.

[8]  Ana Maria Mendonça,et al.  End-to-End Adversarial Retinal Image Synthesis , 2018, IEEE Transactions on Medical Imaging.

[9]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[10]  Debdoot Sheet,et al.  Simulating patho-realistic ultrasound images using deep generative networks with adversarial learning , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[11]  D. Z. Sands,et al.  Impact of abdominal CT on the management of patients presenting to the emergency department with acute abdominal pain. , 2000, AJR. American journal of roentgenology.

[12]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[13]  Snehashis Roy,et al.  Magnetic Resonance Image Example-Based Contrast Synthesis , 2013, IEEE Transactions on Medical Imaging.

[14]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[15]  Vicente Grau,et al.  A Deep Learning Approach to Automate High-Resolution Blood Vessel Reconstruction on Computerized Tomography Images With or Without the Use of Contrast Agent , 2020, ArXiv.

[16]  Ling Shao,et al.  Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images Using Weakly-Supervised Joint Convolutional Sparse Coding , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  F. Moll,et al.  Growth predictors and prognosis of small abdominal aortic aneurysms. , 2008, Journal of vascular surgery.

[19]  Ender A. Finol,et al.  Quantitative Assessment of Abdominal Aortic Aneurysm Geometry , 2010, Annals of Biomedical Engineering.

[20]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[21]  J. L. Herraiz,et al.  Fast Patch-Based Pseudo-CT Synthesis from T1-Weighted MR Images for PET/MR Attenuation Correction in Brain Studies , 2016, The Journal of Nuclear Medicine.

[22]  B. Siewert,et al.  Value of abdominal CT in the emergency department for patients with abdominal pain , 2003, European Radiology.

[23]  Michael M Maher,et al.  Computed tomography and patient risk: Facts, perceptions and uncertainties , 2016, World journal of radiology.

[24]  Alka Sharma,et al.  ABDOMINAL AORTIC ANEURYSM: A COMPREHENSIVE REVIEW , 2011 .

[25]  T Christian Gasser,et al.  Multidimensional growth measurements of abdominal aortic aneurysms. , 2013, Journal of vascular surgery.

[26]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[28]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[29]  Ninon Burgos,et al.  Attenuation Correction Synthesis for Hybrid PET-MR Scanners: Application to Brain Studies , 2014, IEEE Transactions on Medical Imaging.