Robust real-time myocardial border tracking for echocardiography: an information fusion approach

Ultrasound is a main noninvasive modality for the assessment of the heart function. Wall tracking from ultrasound data is, however, inherently difficult due to weak echoes, clutter, poor signal-to-noise ratio, and signal dropouts. To cope with these artifacts, pretrained shape models can be applied to constrain the tracking. However, existing methods for incorporating subspace shape constraints in myocardial border tracking use only partial information from the model distribution, and do not exploit spatially varying uncertainties from feature tracking. In this paper, we propose a complete fusion formulation in the information space for robust shape tracking, optimally resolving uncertainties from the system dynamics, heteroscedastic measurement noise, and subspace shape model. We also exploit information from the ground truth initialization where this is available. The new framework is applied for tracking of myocardial borders in very noisy echocardiography sequences. Numerous myocardium tracking experiments validate the theory and show the potential of very accurate wall motion measurements. The proposed framework outperforms the traditional shape-space-constrained tracking algorithm by a significant margin. Due to the optimal fusion of different sources of uncertainties, robust performance is observed even for the most challenging cases.

[1]  P. Simard,et al.  Restoration of the velocity field of the heart from two-dimensional echocardiograms. , 1989, IEEE transactions on medical imaging.

[2]  Michal Irani,et al.  Multi-frame optical flow estimation using subspace constraints , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[4]  Yunmin Zhu,et al.  Unified optimal linear estimation fusion. I. Unified models and fusion rules , 2000, Proceedings of the Third International Conference on Information Fusion.

[5]  J. Alison Noble,et al.  A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography , 2002, IEEE Transactions on Medical Imaging.

[6]  Chandra Kambhamettu,et al.  A Coarse-to-Fine Deformable Contour Optimization Framework , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Patrick Clarysse,et al.  Tracking geometrical descriptors on 3-D deformable surfaces: application to the left-ventricular surface of the heart , 1997, IEEE Transactions on Medical Imaging.

[8]  T. Gustavsson,et al.  Tracking contrast in echocardiography by a combined snake and optical flow technique , 2000, Computers in Cardiology 2000. Vol.27 (Cat. 00CH37163).

[9]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[10]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[11]  Donald W. Marquaridt Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear Estimation , 1970 .

[12]  R. German Sintering theory and practice , 1996 .

[13]  Jim Graham,et al.  Robust Active Shape Model Search , 2002, ECCV.

[14]  Daniel Rueckert,et al.  Atlas-based segmentation of 4d cardiac mr sequences using non-rigid registration , 2002 .

[15]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[16]  Yaakov Bar-Shalom,et al.  The Effect of the Common Process Noise on the Two-Sensor Fused-Track Covariance , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[17]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[18]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Timothy F. Cootes,et al.  Statistical models of appearance for medical image analysis and computer vision , 2001, SPIE Medical Imaging.

[20]  Michael Isard,et al.  Learning to Track the Visual Motion of Contours , 1995, Artif. Intell..

[21]  Shang-Hong Lai,et al.  Reliable and Efficient Computation of Optical Flow , 1998, International Journal of Computer Vision.

[22]  Yongmin Kim,et al.  A multiple active contour model for cardiac boundary detection on echocardiographic sequences , 1996, IEEE Trans. Medical Imaging.

[23]  Max Mignotte,et al.  Endocardial Boundary E timation and Tracking in Echocardiographic Images using Deformable Template and Markov Random Fields , 2001, Pattern Analysis & Applications.

[24]  Petia Radeva,et al.  Tag surface reconstruction and tracking of myocardial beads from SPAMM-MRI with parametric B-spline surfaces , 2001, IEEE Transactions on Medical Imaging.

[25]  Andrew Blake,et al.  Evaluating a robust contour tracker on echocardiographic sequences , 1999, Medical Image Anal..

[26]  Ralph R. Martin,et al.  Merging and Splitting Eigenspace Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Dorin Comaniciu,et al.  Nonparametric information fusion for motion estimation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[28]  Henning Biermann,et al.  Recovering non-rigid 3D shape from image streams , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[29]  Samuel Sideman,et al.  Semiautomated Border Tracking of Cine Echocardiographic Ventnrcular Images , 1987, IEEE Transactions on Medical Imaging.

[30]  Andrew Blake,et al.  Robust contour tracking in echocardiographic sequences , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[31]  Thomas S. Huang,et al.  Parametric contour tracking using unscented Kalman filter , 2002, Proceedings. International Conference on Image Processing.

[32]  Nicholas Ayache,et al.  Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information , 2001, IEEE Transactions on Medical Imaging.

[33]  Dorin Comaniciu,et al.  An Algorithm for Data-Driven Bandwidth Selection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[35]  Michael Unser,et al.  Motion analysis of echocardiograms using a local-affine, spatio-temporal model , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[36]  James B. Seward,et al.  The echo manual , 2006 .

[37]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[38]  Shai Avidan,et al.  Support Vector Tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[39]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[40]  Zhizhou Wang,et al.  Deformable Pedal Curves and Surfaces: Hybrid Geometric Active Models for Shape Recovery , 2004, International Journal of Computer Vision.

[41]  Milan Sonka,et al.  Time-continuous segmentation of cardiac MR image sequences using active appearance motion models , 2001, SPIE Medical Imaging.

[42]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[43]  Dimitris N. Metaxas,et al.  Automated Segmentation of the Left and Right Ventricles in 4D Cardiac SPAMM Images , 2002, MICCAI.

[44]  James S. Duncan,et al.  Shape-based tracking of left ventricular wall motion , 1997, IEEE Transactions on Medical Imaging.

[45]  Nebojsa Jojic,et al.  Tracking self-occluding articulated objects in dense disparity maps , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[46]  James D. Thomas,et al.  Segmentation and tracking in echocardiographic sequences: active contours guided by optical flow estimates , 1998, IEEE Transactions on Medical Imaging.

[47]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[48]  Peter Meer,et al.  Reduction of bias in maximum likelihood ellipse fitting , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[49]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[50]  Matthew Brand,et al.  Flexible flow for 3D nonrigid tracking and shape recovery , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[51]  Peter Meer,et al.  Heteroscedastic Regression in Computer Vision: Problems with Bilinear Constraint , 2000, International Journal of Computer Vision.

[52]  Kenichi Kanatani,et al.  Do we really have to consider covariance matrices for image features? , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[53]  David C. Hogg,et al.  An efficient method for contour tracking using active shape models , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[54]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[56]  Edward J. Wegman,et al.  Statistical Signal Processing , 1985 .