Deep learning angiography (DLA): three-dimensional C-arm cone beam CT angiography generated from deep learning method using a convolutional neural network

Current clinical 3D-DSA requires the acquisition of two image volumes, before and after the injection of contrast media (i.e. mask and fill scans). Deep learning angiography (DLA) is a recently developed technique that enables the generation of mask-free 3D angiography using convolutional neural networks (CNN). In this work, the quantitative performance of DLA as a function of the number of layers in the deep neural network and the DLA inference computation time are investigated. Clinically indicated rotational angiography exams of 105 patients scanned with a C-arm conebeam CT system using a standard 3D-DSA imaging protocol for the assessment of cerebrovascular abnormalities were retrospectively collected. More than 185 million labeled voxels from contrast-enhanced images of 43 subjects were used as training and testing dataset. Multiple deep CNNs were trained to perform DLA. The trained DLA models were then applied in a validation cohort consisting of the remaining image volumes from 62 subjects and accuracy, sensitivity, precision and F1-scores were calculated for vasculature classification in relevant anatomy. The implementation of the best performing model was optimized for accelerated DLA inference and the computation time was measured under multiple hardware configurations. Vasculature classification accuracy and 95% CI in the validation dataset were 98.7% ([98.3, 99.1] %) for the best performing model. DLA inference user time was 17 seconds for a throughput of 23 images/s. In conclusion, a 30-layer DLA model outperformed shallower networks and DLA inference computation time was demonstrated not be a limiting factor for current clinical practice.

[1]  John Tran,et al.  cuDNN: Efficient Primitives for Deep Learning , 2014, ArXiv.

[2]  Yinsheng Li,et al.  Deep Learning Angiography (DLA): Three-dimensional C-arm Cone Beam CT Angiography Using Deep Learning , 2018, ArXiv.

[3]  D. Kondziolka,et al.  Recommendations for the management of intracranial arteriovenous malformations: a statement for healthcare professionals from a special writing group of the Stroke Council, American Stroke Association. , 2001, Circulation.

[4]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[5]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Y Trousset,et al.  Intracranial aneurysms: clinical value of 3D digital subtraction angiography in the therapeutic decision and endovascular treatment. , 2001, Radiology.

[7]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[8]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[9]  A. Osborn Current Imaging Assessment and Treatment of Intracranial Aneurysms , 2011 .

[10]  D. Gandhi,et al.  Intracranial Dural Arteriovenous Fistulas: Classification, Imaging Findings, and Treatment , 2012, American Journal of Neuroradiology.

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[14]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[15]  Bradley J. Erickson,et al.  Residual Deep Convolutional Neural Network Predicts MGMT Methylation Status , 2017, Journal of Digital Imaging.