Shape-Regularized Unsupervised Left Ventricular Motion Network With Segmentation Capability In 3d+ Time Echocardiography

Accurate motion estimation and segmentation of the left ventricle from medical images are important tasks for quantitative evaluation of cardiovascular health. Echocardiography offers a cost-efficient and non-invasive modality for examining the heart, but provides additional challenges for automated analyses due to the low signal-to-noise ratio inherent in ultrasound imaging. In this work, we propose a shape regularized convolutional neural network for estimating dense displacement fields between sequential 3D B-mode echocardiography images with the capability of also predicting left ventricular segmentation masks. Manually traced segmentations are used as a guide to assist in the unsupervised estimation of displacement between a source and a target image while also serving as labels to train the network to additionally predict segmentations. To enforce realistic cardiac motion patterns, a flow incompressibility term is also incorporated. Our proposed network is evaluated on an in vivo canine 3D+t B-mode echocardiographic dataset. It is shown that the shape regularizer improves the motion estimation performance of the network and our overall model performs favorably against competing methods.

[1]  Daguang Xu,et al.  NeurReg: Neural Registration and Its Application to Image Segmentation , 2019, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[2]  James S. Duncan,et al.  Regional myocardial strain analysis via 2D speckle tracking echocardiography: validation with sonomicrometry and correlation with regional blood flow in the presence of graded coronary stenoses and dobutamine stress , 2020, Cardiovascular Ultrasound.

[3]  R. Leahy,et al.  Computation of 3-D velocity fields from 3-D cine CT images of a human heart. , 1991, IEEE transactions on medical imaging.

[4]  James S. Duncan,et al.  Point-tracked quantitative analysis of left ventricular surface motion from 3-D image sequences , 2000, IEEE Transactions on Medical Imaging.

[5]  James S. Duncan,et al.  Generalized robust point matching using an extended free-form deformation model: application to cardiac images , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[6]  Mert R. Sabuncu,et al.  An Unsupervised Learning Model for Deformable Medical Image Registration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[8]  James S. Duncan,et al.  Unsupervised motion tracking of left ventricle in echocardiography , 2020, Medical Imaging.

[9]  James S. Duncan,et al.  Flow Network Tracking for Spatiotemporal and Periodic Point Matching: Applied to Cardiac Motion Analysis , 2018, Medical Image Anal..

[10]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[11]  Thomas Brox,et al.  FlowNet: Learning Optical Flow with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics—2020 Update: A Report From the American Heart Association , 2020, Circulation.

[13]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[14]  James S. Duncan,et al.  A Semi-Supervised Joint Learning Approach to Left Ventricular Segmentation and Motion Tracking in Echocardiography , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).