Interactive Medical Image Segmentation using PDE Control of Active Contours

Segmentation of injured or unusual anatomic structures in medical imagery is a problem that has continued to elude fully automated solutions. In this paper, the goal of easy-to-use and consistent interactive segmentation is transformed into a control synthesis problem. A nominal level set partial differential equation (PDE) is assumed to be given; this open-loop system achieves correct segmentation under ideal conditions, but does not agree with a human expert's ideal boundary for real image data. Perturbing the state and dynamics of a level set PDE via the accumulated user input and an observer-like system leads to desirable closed-loop behavior. The input structure is designed such that a user can stabilize the boundary in some desired state without needing to understand any mathematical parameters. Effectiveness of the technique is illustrated with applications to the challenging segmentations of a patellar tendon in magnetic resonance and a shattered femur in computed tomography.

[1]  Ricardo G. Durán,et al.  An optimal Poincare inequality in L^1 for convex domains , 2003 .

[2]  Jean-Philippe Thiran,et al.  Non-Euclidean image-adaptive Radial Basis Functions for 3D interactive segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Rachid Deriche,et al.  Coupled Geodesic Active Regions for Image Segmentation: A Level Set Approach , 2000, ECCV.

[4]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[5]  Miroslav Krstic,et al.  Further Results on Stabilization of Shock-Like Equilibria of the Viscous Burgers PDE , 2010, IEEE Transactions on Automatic Control.

[6]  E L Nickoloff,et al.  Radiation exposures to patients from CT: reality, public perception, and policy. , 2001, AJR. American journal of roentgenology.

[7]  Amar Mitiche,et al.  A Region Merging Prior for Variational Level Set Image Segmentation , 2008, IEEE Transactions on Image Processing.

[8]  P. Smereka,et al.  A Remark on Computing Distance Functions , 2000 .

[9]  Wiro J. Niessen,et al.  Accuracy and reproducibility study of automatic MRI brain tissue segmentation methods , 2010, NeuroImage.

[10]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[11]  Marc Niethammer,et al.  Dynamic active contours for visual tracking , 2006, IEEE Transactions on Automatic Control.

[12]  John W. Fisher,et al.  Submitted to Ieee Transactions on Image Processing a Nonparametric Statistical Method for Image Segmentation Using Information Theory and Curve Evolution , 2022 .

[13]  Nikos Paragios,et al.  Prior Knowledge, Level Set Representations & Visual Grouping , 2008, International Journal of Computer Vision.

[14]  Wenxian Yang,et al.  User-Friendly Interactive Image Segmentation Through Unified Combinatorial User Inputs , 2010, IEEE Transactions on Image Processing.

[15]  Nahum Kiryati,et al.  Interactive level set segmentation for image-guided therapy , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[16]  John Xerogeanes,et al.  Anterior Cruciate Ligament Reconstruction in the Skeletally Immature: An Anatomical Study Utilizing 3-Dimensional Magnetic Resonance Imaging Reconstructions , 2009, Journal of pediatric orthopedics.

[17]  Xavier Litrico,et al.  Boundary stabilization of the inviscid Burgers equation using a Lyapunov method , 2010, 49th IEEE Conference on Decision and Control (CDC).

[18]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[19]  John W. Xerogeanes,et al.  Anatomic Landmarks Utilized for Physeal-Sparing, Anatomic Anterior Cruciate Ligament Reconstruction: An MRI-Based Study (SS-68) , 2011 .

[20]  Catherine Westbrook.  MRI at a Glance , 2002 .

[21]  Jiang Hsieh,et al.  Computed Tomography: Principles, Design, Artifacts, and Recent Advances, Fourth Edition , 2022 .

[22]  Martha Elizabeth Shenton,et al.  A 3D interactive multi-object segmentation tool using local robust statistics driven active contours , 2012, Medical Image Anal..

[23]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[24]  Miroslav Krstic,et al.  Nonlinear Control of the Viscous Burgers Equation: Trajectory Generation, Tracking, and Observer Design , 2009 .

[25]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[26]  Noel E. O'Connor,et al.  A comparative evaluation of interactive segmentation algorithms , 2010, Pattern Recognit..

[27]  Antonios Armaou,et al.  Analysis and control of parabolic PDE systems with input constraints , 2003, Autom..

[28]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Kurt Debattista,et al.  Maintaining frame rate perception in interactive environments by exploiting audio-visual cross-modal interaction , 2010, The Visual Computer.

[30]  Yogesh Rathi,et al.  Image Segmentation Using Active Contours Driven by the Bhattacharyya Gradient Flow , 2007, IEEE Transactions on Image Processing.

[31]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[32]  Alper Yilmaz,et al.  Level Set Methods , 2007, Wiley Encyclopedia of Computer Science and Engineering.

[33]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[34]  L. Koziris,et al.  The American Journal of Sports Medicine , 2004 .

[35]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[36]  Simon Ameer-Beg,et al.  Biomedical Imaging: From Nano to Macro , 2008 .

[37]  H. Weinberger,et al.  An optimal Poincaré inequality for convex domains , 1960 .

[38]  Abdul Rahman Ramli,et al.  Review of brain MRI image segmentation methods , 2010, Artificial Intelligence Review.

[39]  Miroslav Krstic,et al.  Backstepping boundary control for first order hyperbolic PDEs and application to systems with actuator and sensor delays , 2007, CDC.

[40]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  M E Easterly,et al.  A review of high-resolution X-ray computed tomography and other imaging modalities for small animal research. , 2001, Lab animal.

[42]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[43]  Heinz-Otto Peitgen,et al.  Interactive 3D medical image segmentation with energy-minimizing implicit functions , 2011, Comput. Graph..

[44]  Arnold W. M. Smeulders,et al.  Interaction in the segmentation of medical images: A survey , 2001, Medical Image Anal..

[45]  Miroslav Krstic,et al.  Local exponential H2 stabilization of a 2 × 2 quasilinear hyperbolic system using backstepping , 2011, IEEE Conference on Decision and Control and European Control Conference.

[46]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[47]  Said Kouachi,et al.  Explicit Invariant Regions and Global Existence of Solutions for Reaction Diffusion Systems With a Full Matrix of Diffusion Coefficients and Nonhomogeneous Boundary Conditions , 2012 .

[48]  Jens H. Krüger,et al.  Tuvok, an Architecture for Large Scale Volume Rendering , 2010, VMV.

[49]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[50]  Miroslav Krstic,et al.  Adaptive control of PDEs , 2008, Annu. Rev. Control..

[51]  Daniel Cremers,et al.  Dynamical statistical shape priors for level set-based tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[53]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[54]  Noel E. O'Connor,et al.  Toward automated evaluation of interactive segmentation , 2011, Comput. Vis. Image Underst..

[55]  Olivier D. Faugeras,et al.  Reconciling Distance Functions and Level Sets , 1999, Scale-Space.

[56]  Miroslav Krstic,et al.  Backstepping boundary control for first order hyperbolic PDEs and application to systems with actuator and sensor delays , 2007, 2007 46th IEEE Conference on Decision and Control.

[57]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[58]  Ron Kikinis,et al.  Simultaneous Multi-object Segmentation Using Local Robust Statistics and Contour Interaction , 2010, MCV.

[59]  Allen R. Tannenbaum,et al.  Interactive MRI segmentation with controlled active vision , 2011, IEEE Conference on Decision and Control and European Control Conference.

[60]  LuoJiebo,et al.  User-friendly interactive image segmentation through unified combinatorial user inputs , 2010 .

[61]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[62]  LiChunming,et al.  Distance regularized level set evolution and its application to image segmentation , 2010 .