Joint edge detection and motion estimation of cardiac MR image sequence by a phase field method

In this paper a variational framework for joint segmentation and motion estimation is employed for inspecting heart in Cine MRI sequences. A functional including Mumford-Shah segmentation and optical flow based dense motion estimation is approximated using the phase-field technique. The minimizer of the functional provides an optimum motion field and edge set by considering both spatial and temporal discontinuities. Exploiting calculus of variation principles, multiple partial differential equations associated with the Euler-Lagrange equations of the functional are extracted, first. Next, the finite element method is used to discretize the resulting PDEs for numerical solution. Several simulation runs are used to test the convergence and the parameter sensitivity of the method. It is further applied to a comprehensive set of clinical data in order to compare with conventional cascade methods. Developmental constraints are identified as memory usage and computational complexities, which may be resolved utilizing sparse matrix manipulations and similar techniques. Based on the results of this study, joint segmentation and motion estimation outperforms previously reported cascade approaches especially in segmentation. Experimental results substantiated that the proposed method extracts the motion field and the edge set more precisely in comparison with conventional cascade approaches. This superior result is the consequence of simultaneously considering the discontinuity in both motion field and image space and including consequent frames (usually five) in our joint process functional.

[1]  Milan Sonka,et al.  Multistage hybrid active appearance model matching: segmentation of left and right ventricles in cardiac MR images , 2001, IEEE Transactions on Medical Imaging.

[2]  A. Chambolle,et al.  Discrete approximation of the Mumford-Shah functional in dimension two , 1999, ESAIM: Mathematical Modelling and Numerical Analysis.

[3]  Rachid Deriche,et al.  Computing Optical Flow via Variational Techniques , 1999, SIAM J. Appl. Math..

[4]  Warren J Manning,et al.  Clinical indications for cardiovascular magnetic resonance (CMR): Consensus Panel report. , 2004, Journal of cardiovascular magnetic resonance : official journal of the Society for Cardiovascular Magnetic Resonance.

[5]  Thomas Brox,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Highly Accurate Optic Flow Computation with Theoretically Justified Warping Highly Accurate Optic Flow Computation with Theoretically Justified Warping , 2022 .

[6]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[7]  P. Solín Partial differential equations and the finite element method , 2005 .

[8]  Thomas Brox,et al.  Variational Motion Segmentation with Level Sets , 2006, ECCV.

[9]  H. Batatia,et al.  Robust level set for heart cavities detection in ultrasound images , 2005, Computers in Cardiology, 2005.

[10]  Daniel Cremers,et al.  Nonlinear Shape Statistics in Mumford-Shah Based Segmentation , 2002, ECCV.

[11]  Boudewijn P. F. Lelieveldt,et al.  Cardiac LV Segmentation Using a 3D Active Shape Model Driven by Fuzzy Inference , 2003, MICCAI.

[12]  Paolo Nesi,et al.  Variational approach to optical flow estimation managing discontinuities , 1993, Image Vis. Comput..

[13]  Antonin Chambolle,et al.  Implementation of an adaptive finite-element approximation of the Mumford-Shah functional , 2000, Numerische Mathematik.

[14]  C. Lamberti,et al.  Application of continuum theory and multi-grid methods to motion evaluation from 3D echocardiography , 1997, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[15]  Rachid Deriche,et al.  Image Sequence Analysis via Partial Differential Equations , 1999, Journal of Mathematical Imaging and Vision.

[16]  José M. F. Moura,et al.  STACS: new active contour scheme for cardiac MR image segmentation , 2005, IEEE Transactions on Medical Imaging.

[17]  Pavel Šolín Partial Differential Equations and the Finite Element Method: Šolín/Method , 2005 .

[18]  Edward H. Adelson,et al.  A unified mixture framework for motion segmentation: incorporating spatial coherence and estimating the number of models , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  G. Aubert,et al.  A mathematical study of the relaxed optical flow problem in the space BV (&Ω) , 1999 .

[20]  Ioannis A. Kakadiaris,et al.  Automated left ventricular segmentation in cardiac MRI , 2006, IEEE Transactions on Biomedical Engineering.

[21]  Jürgen Weese,et al.  Automated segmentation of the left ventricle in cardiac MRI , 2004, Medical Image Anal..

[22]  B. Brunt The calculus of variations , 2003 .

[23]  Daniel Cremers,et al.  Shape priors in variational image segmentation: Convexity, Lipschitz continuity and globally optimal solutions , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Martin Rumpf,et al.  A Phase Field Method for Joint Denoising, Edge Detection, and Motion Estimation in Image Sequence Processing , 2007, SIAM J. Appl. Math..

[25]  Daniel Cremers,et al.  Motion Competition: A Variational Approach to Piecewise Parametric Motion Segmentation , 2005, International Journal of Computer Vision.

[26]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  P. Simard,et al.  Restoration of the velocity field of the heart from two-dimensional echocardiograms. , 1989, IEEE transactions on medical imaging.

[28]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[29]  Milan Sonka,et al.  Automatic segmentation of echocardiographic sequences by active appearance motion models , 2002, IEEE Transactions on Medical Imaging.

[30]  Luigi Ambrosio,et al.  ON THE APPROXIMATION OF FREE DISCONTINUITY PROBLEMS , 1992 .

[31]  B. Bourdin Image segmentation with a finite element method , 1999 .

[32]  J. Weickert,et al.  A Confidence Measure for Variational Optic flow Methods , 2006 .

[33]  Nuno Vasconcelos,et al.  Empirical Bayesian Motion Segmentation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Marc Droske,et al.  A Mumford-Shah Level-Set Approach for Geometric Image Registration , 2006, SIAM J. Appl. Math..

[35]  Juha Koikkalainen,et al.  Statistical shape model of atria, ventricles and epicardium from short- and long-axis MR images , 2004, Medical Image Anal..

[36]  M. Droske,et al.  Mumford–Shah based registration: a comparison of a level set and a phase field approach , 2009 .

[37]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[38]  Stephen L. Keeling,et al.  Medical Image Registration and Interpolation by Optical Flow with Maximal Rigidity , 2005, Journal of Mathematical Imaging and Vision.

[39]  N. Paragios A level set approach for shape-driven segmentation and tracking of the left ventricle , 2003, IEEE Transactions on Medical Imaging.

[40]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  A. Lalande,et al.  Magnetic resonance image segmentation and heart motion tracking with an active mesh based system , 2002, Computers in Cardiology.

[42]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[43]  Michael Unser,et al.  Myocardial motion analysis from B-mode echocardiograms , 2005, IEEE Transactions on Image Processing.

[44]  Hans Sagan,et al.  Introduction to the Calculus of Variations. , 1969 .