A Deep Learning Approach to Resolve Aliasing Artifacts in Ultrasound Color Flow Imaging

Despite being used clinically as a noninvasive flow visualization tool, color flow imaging (CFI) is known to be prone to aliasing artifacts that arise due to fast blood flow beyond the detectable limit. From a visualization standpoint, these aliasing artifacts obscure proper interpretation of flow patterns in the image view. Current solutions for resolving aliasing artifacts are typically not robust against issues such as double aliasing. In this article, we present a new dealiasing technique based on deep learning principles to resolve CFI aliasing artifacts that arise from single- and double-aliasing scenarios. It works by first using two convolutional neural networks (CNNs) to identify and segment CFI pixel positions with aliasing artifacts, and then it performs phase unwrapping at these aliased pixel positions. The CNN for aliasing identification was devised as a U-net architecture, and it was trained with in vivo CFI frames acquired from the femoral bifurcation that had known presence of single- and double-aliasing artifacts. Results show that the segmentation of aliased CFI pixels was achieved successfully with intersection over union approaching 90%. After resolving these artifacts, the dealiased CFI frames consistently rendered the femoral bifurcation’s triphasic flow dynamics over a cardiac cycle. For dealiased CFI pixels, their root-mean-squared difference was 2.51% or less compared with manual dealiasing. Overall, the proposed dealiasing framework can extend the maximum flow detection limit by fivefold, thereby improving CFI’s flow visualization performance.

[1]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[2]  Damien Garcia,et al.  Unsupervised dealiasing and denoising of color-Doppler data , 2011, Medical Image Anal..

[3]  M E Anderson,et al.  Speckle tracking for multi-dimensional flow estimation. , 2000, Ultrasonics.

[4]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  C. Merritt,et al.  Doppler color flow imaging , 1987, Journal of clinical ultrasound : JCU.

[7]  C. Kasai,et al.  Real-Time Two-Dimensional Blood Flow Imaging Using an Autocorrelation Technique , 1985, IEEE 1985 Ultrasonics Symposium.

[8]  Ingvild Kinn Ekroll,et al.  Robust angle-independent blood velocity estimation based on multi-angle speckle tracking and vector Doppler , 2014, 2014 IEEE International Ultrasonics Symposium.

[9]  Damien Garcia,et al.  Staggered Multiple-PRF Ultrafast Color Doppler , 2016, IEEE Transactions on Medical Imaging.

[10]  Maja Cikes,et al.  Ultrafast cardiac ultrasound imaging: technical principles, applications, and clinical benefits. , 2014, JACC. Cardiovascular imaging.

[11]  S. Torp-Pedersen,et al.  Settings and artefacts relevant for Doppler ultrasound in large vessel vasculitis , 2017, Arthritis Research & Therapy.

[12]  Patrick Segers,et al.  Two-dimensional flow imaging in the carotid bifurcation using a combined speckle tracking and phase-shift estimator: a study based on ultrasound simulations and in vivo analysis. , 2010, Ultrasound in medicine & biology.

[13]  B. Y. S. Yiu,et al.  GPU-based beamformer: Fast realization of plane wave compounding and synthetic aperture imaging , 2011, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[14]  Billy Y. S. Yiu,et al.  Least-Squares Multi-Angle Doppler Estimators for Plane-Wave Vector Flow Imaging , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[15]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[16]  Lu Lu,et al.  Dying ReLU and Initialization: Theory and Numerical Examples , 2019, Communications in Computational Physics.

[17]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[19]  Jong Chul Ye,et al.  Understanding Geometry of Encoder-Decoder CNNs , 2019, ICML.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[22]  Ammar A. Oglat,et al.  A Review of Medical Doppler Ultrasonography of Blood Flow in General and Especially in Common Carotid Artery , 2018, Journal of medical ultrasound.

[23]  Damien Garcia,et al.  Ultrasound Vector Flow Imaging: II: Parallel Systems. , 2016, IEEE transactions on ultrasonics, ferroelectrics, and frequency control.

[24]  Manfred Kaps,et al.  Grading carotid stenosis using ultrasonic methods. , 2012, Stroke.

[25]  Alfred C. H. Yu,et al.  Segmentation of Aliasing Artefacts in Ultrasound Color Flow Imaging Using Convolutional Neural Networks , 2019, ICIAR.

[26]  André Garon,et al.  Vascular Stenosis: An Introduction , 2015 .

[27]  Alfredo Goddi,et al.  High-frame rate vector flow imaging of the carotid bifurcation , 2017, Insights into Imaging.

[28]  Kristoffer Lindskov Hansen,et al.  Intra-Operative Vector Flow Imaging Using Ultrasound of the Ascending Aorta among 40 Patients with Normal, Stenotic and Replaced Aortic Valves. , 2016, Ultrasound in medicine & biology.

[29]  J. Hwang,et al.  Doppler ultrasonography of the lower extremity arteries: anatomy and scanning guidelines , 2017, Ultrasonography.

[30]  Kristoffer Lindskov Hansen,et al.  Aortic Valve Stenosis Increases Helical Flow and Flow Complexity: A Study of Intra-Operative Cardiac Vector Flow Imaging. , 2017, Ultrasound in medicine & biology.

[31]  Billy Y S Yiu,et al.  Vector projectile imaging: time-resolved dynamic visualization of complex flow patterns. , 2014, Ultrasound in medicine & biology.

[32]  K. Kristoffersen,et al.  An extended autocorrelation method for estimation of blood velocity , 1997, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[33]  W D Foley,et al.  Color Doppler flow imaging. , 1991, AJR. American journal of roentgenology.

[34]  Damien Garcia,et al.  Ultrasound Vector Flow Imaging—Part I: Sequential Systems , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[35]  Billy Y. S. Yiu,et al.  Live Ultrasound Color-Encoded Speckle Imaging Platform for Real-Time Complex Flow Visualization In Vivo , 2019, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[36]  Alfredo Goddi,et al.  High–Frame Rate Vector Flow Imaging of the Carotid Bifurcation in Healthy Adults: Comparison With Color Doppler Imaging , 2018, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[37]  Damien Garcia,et al.  Doppler vortography: a color Doppler approach to quantification of intraventricular blood flow vortices. , 2014, Ultrasound in medicine & biology.

[38]  Takuro Ishii,et al.  Vector Flow Visualization of Urinary Flow Dynamics in a Bladder Outlet Obstruction Model. , 2017, Ultrasound in medicine & biology.

[39]  Michel Ménard,et al.  Cooperation of fuzzy segmentation operators for correction aliasing phenomenon in 3D color Doppler imaging , 2000, Artif. Intell. Medicine.

[40]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Abigail Swillens,et al.  An Extended Least Squares Method for Aliasing-Resistant Vector Velocity Estimation , 2016, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.