Shape recovery algorithms using level sets in 2-D/3-D medical imagery: a state-of-the-art review

The class of geometric deformable models, also known as level sets, has brought tremendous impact to medical imagery due to its capability of topology preservation and fast shape recovery. In an effort to facilitate a clear and full understanding of these powerful state-of-the-art applied mathematical tools, the paper is an attempt to explore these geometric methods, their implementations and integration of regularizers to improve the robustness of these topologically independent propagating curves/surfaces. The paper first presents the origination of level sets, followed by the taxonomy of level sets. We then derive the fundamental equation of curve/surface evolution and zero-level curves/surfaces. The paper then focuses on the first core class of level sets, known as "level sets without regularizers." This class presents five prototypes: gradient, edge, area-minimization, curvature-dependent and application driven. The next section is devoted to second core class of level sets, known as "level sets with regularizers." In this class, we present four kinds: clustering-based, Bayesian bidirectional classifier-based, shape-based and coupled constrained-based. An entire section is dedicated to optimization and quantification techniques for shape recovery when used in the level set framework. Finally, the paper concludes with 22 general merits and four demerits on level sets and the future of level sets in medical image segmentation. We present applications of level sets to complex shapes like the human cortex acquired via MRI for neurological image analysis.

[1]  Jasjit S. Suri,et al.  Computer Vision, Pattern Recognition and Image Processing in Left Ventricle Segmentation: The Last 50 Years , 2000, Pattern Analysis & Applications.

[2]  Michael W. Vannier,et al.  Editorial Car Special Issue Of The IEEE Transactions On Information Technology In Biomedicine , 1997, IEEE Trans. Inf. Technol. Biomed..

[3]  R. Milne An Adaptive Level Set Method , 1995 .

[4]  James A. Sethian,et al.  A real-time algorithm for medical shape recovery , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  O. Faugeras,et al.  Variational principles, surface evolution, PDE's, level set methods and the stereo problem , 1998, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[6]  T. Chan,et al.  A Variational Level Set Approach to Multiphase Motion , 1996 .

[7]  Olivier D. Faugeras,et al.  Co-dimension 2 Geodesic Active Contours for MRA Segmentation , 1999, IPMI.

[8]  J. Wilhelms,et al.  Octrees for faster isosurface generation , 1992, TOGS.

[9]  Janusz Konrad,et al.  Multiple motion segmentation with level sets , 2003, IEEE Trans. Image Process..

[10]  James A. Sethian,et al.  A unified approach to noise removal, image enhancement, and shape recovery , 1996, IEEE Trans. Image Process..

[11]  L O Hall,et al.  Review of MR image segmentation techniques using pattern recognition. , 1993, Medical physics.

[12]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[13]  James A. Sethian,et al.  A Level Set Approach to a Unified Model for Etching, Deposition, and Lithography I: Algorithms and T , 1995 .

[14]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[15]  L. Evans,et al.  Motion of level sets by mean curvature. II , 1992 .

[16]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[17]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Rachid Deriche,et al.  Image Sequence Analysis via Partial Differential Equations , 1999, Journal of Mathematical Imaging and Vision.

[19]  J. Sethian,et al.  Crystal growth and dendritic solidification , 1992 .

[20]  Yun-Gang Chen,et al.  Uniqueness and existence of viscosity solutions of generalized mean curvature flow equations , 1989 .

[21]  J. Ball GENERALIZED SOLUTIONS OF HAMILTON-JACOBI EQUATIONS (Research Notes in Mathematics, 69) , 1983 .

[22]  Paolo Cignoni,et al.  Speeding Up Isosurface Extraction Using Interval Trees , 1997, IEEE Trans. Vis. Comput. Graph..

[23]  Olivier D. Faugeras,et al.  Codimension-two geodesic active contours for the segmentation of tubular structures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[24]  James A. Sethian,et al.  Theory, algorithms, and applications of level set methods for propagating interfaces , 1996, Acta Numerica.

[25]  James A. Sethian,et al.  Flow under Curvature: Singularity Formation, Minimal Surfaces, and Geodesics , 1993, Exp. Math..

[26]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[27]  Anthony J. Yezzi,et al.  A statistical approach to snakes for bimodal and trimodal imagery , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Ross T. Whitaker,et al.  Algorithms for implicit deformable models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[29]  J. Suri,et al.  Advanced algorithmic approaches to medical image segmentation: state-of-the-art application in cardiology, neurology, mammography and pathology , 2001 .

[30]  Olivier D. Faugeras,et al.  Variational principles, surface evolution, PDEs, level set methods, and the stereo problem , 1998, IEEE Trans. Image Process..

[31]  R. Kimmel,et al.  Minimal surfaces: a geometric three dimensional segmentation approach , 1997 .

[32]  Ron Kimmel,et al.  A general framework for low level vision , 1998, IEEE Trans. Image Process..

[33]  DericheRachid,et al.  Image Sequence Analysis via Partial Differential Equations , 1999 .

[34]  W. Lorensen,et al.  Two algorithms for the three-dimensional reconstruction of tomograms. , 1988, Medical physics.

[35]  P. Olver,et al.  Conformal curvature flows: From phase transitions to active vision , 1996, ICCV 1995.

[36]  Robert M. Haralick,et al.  Greedy Algorithm for Error Correction in Automatically Produced Boundaries from Low Contrast Ventriculograms , 2000, Pattern Analysis & Applications.

[37]  J. Sethian,et al.  An O(N log N) algorithm for shape modeling. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[38]  S. Osher,et al.  Computing interface motion in compressible gas dynamics , 1992 .

[39]  Janusz Konrad,et al.  Motion segmentation with level sets , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[40]  Douglas DeCarlo,et al.  Topological Evolution of Surfaces , 1996, Graphics Interface.

[41]  J. Sethian,et al.  Dynamical behaviour of a premixed turbulent open V-flame , 1995 .

[42]  David L. Chopp,et al.  Computation of Self-Similar Solutions for Mean Curvature Flow , 1994, Exp. Math..

[43]  D. Chopp Numerical Computation of Self-Similar Solutions for Mean Curvature Fl ow , 1993 .

[44]  Benjamin B. Kimia,et al.  Shocks from images: propagation of orientation elements , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[46]  Alexandre Lenoir,et al.  Topology Preservation Within Digital Surfaces , 2000, Graph. Model..

[47]  Luc Vincent,et al.  Mathematical morphology: The Hamilton-Jacobi connection , 1993, 1993 (4th) International Conference on Computer Vision.

[48]  S. Osher,et al.  A level set approach for computing solutions to incompressible two-phase flow , 1994 .

[49]  J. Sethian,et al.  A geometric approach to segmentation and analysis of 3D medical images , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[50]  Sameer Singh,et al.  Advanced Algorithmic Approaches to Medical Image Segmentation , 2002, Advances in Computer Vision and Pattern Recognition.

[51]  D. Chopp,et al.  A Computed example of nonuniqueness of mean curvature flow in R3 , 1995 .

[52]  J. Sethian Numerical algorithms for propagating interfaces: Hamilton-Jacobi equations and conservation laws , 1990 .

[53]  setsAbdol-Reza Mansouri Minimum description length region tracking with level , 2000 .

[54]  Kaleem Siddiqi,et al.  Hyperbolic "Smoothing" of shapes , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[55]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[56]  Han-Wei Shen,et al.  A Near Optimal Isosurface Extraction Algorithm Using the Span Space , 1996, IEEE Trans. Vis. Comput. Graph..

[57]  Robert T. Schultz,et al.  Segmentation and Measurement of the Cortex from 3D MR Images , 1998, MICCAI.

[58]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Tien-Tsin Wong,et al.  Multiresolution Isosurface Extraction with Adaptive Skeleton Climbing , 1998, Comput. Graph. Forum.

[60]  K Siddiqi,et al.  Parts of Visual Form: Psychophysical Aspects , 1996, Perception.

[61]  Françoise Dibos,et al.  A morphological scheme for mean curvature motion and applications to anisotropic diffusion and motion of level sets , 1994, Proceedings of 1st International Conference on Image Processing.

[62]  R. Malladi,et al.  A unified geometric model for 3D confocal image analysis in cytology , 1998, Proceedings SIBGRAPI'98. International Symposium on Computer Graphics, Image Processing, and Vision (Cat. No.98EX237).

[63]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[64]  Avinash C. Kak,et al.  A deformable model for human organ extraction , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[65]  Alfred M. Bruckstein,et al.  Finding Shortest Paths on Surfaces Using Level Sets Propagation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Jacques-Olivier Lachaud,et al.  Continuous Analogs of Digital Boundaries: A Topological Approach to Iso-Surfaces , 2000, Graph. Model..

[67]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[68]  Janusz Konrad,et al.  Minimum description length region tracking with level sets , 2000, Electronic Imaging.

[69]  R Malladi,et al.  Image processing via level set curvature flow. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[70]  Gérard G. Medioni,et al.  Detection of Intensity Changes with Subpixel Accuracy Using Laplacian-Gaussian Masks , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  O. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2002, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[72]  Rachid Deriche,et al.  Coupled Geodesic Active Regions for Image Segmentation: A Level Set Approach , 2000, ECCV.

[73]  Baba C. Vemuri,et al.  A fast level set based algorithm for topology-independent shape modeling , 1996, Journal of Mathematical Imaging and Vision.

[74]  S. Osher,et al.  High-order essentially nonsocillatory schemes for Hamilton-Jacobi equations , 1990 .

[75]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  Janusz Konrad,et al.  Multiple motion segmentation with level sets , 2000, Electronic Imaging.

[77]  Alfred M. Bruckstein,et al.  Analyzing and Synthesizing Images by Evolving Curves with the Osher-Sethian Method , 1997, International Journal of Computer Vision.

[78]  Baba C. Vemuri,et al.  Evolutionary Fronts for Topology-Independent Shape Modeling and Recoveery , 1994, ECCV.

[79]  Owen Robert Mitchell,et al.  Edge Location to Subpixel Values in Digital Imagery , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  W. Eric L. Grimson,et al.  Adaptive Segmentation of MRI Data , 1995, CVRMed.

[81]  Sameer Singh,et al.  Modeling Segmentation Via Geometric Deformable Regularizers, PDE and Level Sets in Still and Motion Imagery: A Revisit , 2001, Int. J. Image Graph..

[82]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[83]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[84]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[85]  Guillermo Sapiro,et al.  Three Dimensional Object Modeling via Minimal Surfaces , 1996, ECCV.

[86]  Patrick Bouthemy,et al.  Robust Adaptive Segmentation of 3D Medical Images with Level Sets , 1999 .

[87]  Robert M. Haralick,et al.  Automatic quadratic calibration for correction of pixel classification boundaries to an accuracy of 2.5 millimeters: an application in cardiac imaging , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[88]  D. Louis Collins,et al.  Automated extraction and variability analysis of sulcal neuroanatomy , 1999, IEEE Transactions on Medical Imaging.

[89]  Guillermo Sapiro,et al.  Region tracking on level-sets methods , 1999, IEEE Transactions on Medical Imaging.

[90]  Sarah F. Frisken Constrained Elastic Surface Nets: Generating Smooth Surfaces from Binary Segmented Data , 1998, MICCAI.

[91]  Roman Goldenberg,et al.  Fast Geodesic Active Contours , 1999, Scale-Space.

[92]  J. Sethian Curvature Flow and Entropy Conditions Applied to Grid Generation , 1994 .

[93]  J. S. Suri,et al.  Leaking prevention in fast level sets using fuzzy models: an application in MR brain , 2000, Proceedings 2000 IEEE EMBS International Conference on Information Technology Applications in Biomedicine. ITAB-ITIS 2000. Joint Meeting Third IEEE EMBS International Conference on Information Technol.

[94]  Olivier D. Faugeras,et al.  Unfolding the Cerebral Cortex Using Level Set Methods , 1999, Scale-Space.

[95]  J. Sethian AN ANALYSIS OF FLAME PROPAGATION , 1982 .

[96]  James A. Sethian,et al.  Image Processing: Flows under Min/Max Curvature and Mean Curvature , 1996, CVGIP Graph. Model. Image Process..

[97]  M. Gage,et al.  The heat equation shrinking convex plane curves , 1986 .

[98]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[99]  Alexis Gourdon,et al.  Computing the Differential Characteristics of Isointensity Surfaces , 1995, Comput. Vis. Image Underst..

[100]  James V. Miller,et al.  Extracting geometric models through constraint minimization , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[101]  Chang-Kyu Lee Automated boundary tracing using temporal information , 1995 .

[102]  Guillermo Sapiro,et al.  Color Snakes , 1997, Comput. Vis. Image Underst..

[103]  Sameer Singh,et al.  Computer Vision and Pattern Recognition Techniques for 2-D and 3-D MR Cerebral Cortical Segmentation (Part I): A State-of-the-Art Review , 2002, Pattern Analysis & Applications.

[104]  Jasjit S. Suri,et al.  White Matter/Gray Matter Boundary Segmentation Using Geometric Snakes: A Fuzzy Deformable Model , 2001, ICAPR.

[105]  Kaleem Siddiqi,et al.  Area and length minimizing flows for shape segmentation , 1998, IEEE Trans. Image Process..

[106]  Christopher J. Van Wyk,et al.  Algorithms in C++: Fundamentals, Data Structures, Sorting, Searching , 1998 .

[107]  D. Chopp Computing Minimal Surfaces via Level Set Curvature Flow , 1993 .

[108]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[109]  Marko Subasic,et al.  Level Set Methods and Fast Marching Methods , 2003 .

[110]  James A. Sethian,et al.  The Fast Construction of Extension Velocities in Level Set Methods , 1999 .

[111]  Azriel Rosenfeld,et al.  Digital topology: Introduction and survey , 1989, Comput. Vis. Graph. Image Process..

[112]  Fritz Albregtsen,et al.  Fast Computation of Three-Dimensional Geometric Moments Using a Discrete Divergence Theorem and a Generalization to Higher Dimensions , 1997, CVGIP Graph. Model. Image Process..

[113]  Gilles Aubert,et al.  Some Remarks on the Equivalence between 2D and 3D Classical Snakes and Geodesic Active Contours , 2004, International Journal of Computer Vision.

[114]  Baba C. Vemuri,et al.  Hybrid Geometric Active Models for Shape Recovery in Medical Images , 1999, IPMI.

[115]  Jasjit S. Suri Fast WM/GM boundary segmentation from MR images using the relationship between parametric and geometric deformable models , 2001 .

[116]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[117]  A. Yezzi,et al.  On the relationship between parametric and geometric active contours , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[118]  C VemuriBaba,et al.  Shape Modeling with Front Propagation , 1995 .

[119]  M. Grayson The heat equation shrinks embedded plane curves to round points , 1987 .

[120]  Jacques-Olivier Lachaud,et al.  Deformable meshes with automated topology changes for coarse-to-fine three-dimensional surface extraction , 1999, Medical Image Anal..

[121]  Pierre Hellier,et al.  Cooperation between level set techniques and dense 3D registration for the segmentation of brain structures , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[122]  P. Colella,et al.  Local adaptive mesh refinement for shock hydrodynamics , 1989 .

[123]  S. Osher,et al.  A Simple Level Set Method for Solving Stefan Problems , 1997, Journal of Computational Physics.

[124]  Olivier D. Faugeras,et al.  Level Sets and Distance Functions , 2000, ECCV.

[125]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[126]  Max A. Viergever,et al.  Geodesic deformable models for medical image analysis , 1998, IEEE Transactions on Medical Imaging.

[127]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[128]  Shunhua Cao,et al.  Finite-difference solution of the eikonal equation using an efficient, first-arrival, wavefront tracking scheme , 1994 .

[129]  Guillermo Sapiro,et al.  Implementing continuous-scale morphology via curve evolution , 1993, Pattern Recognit..

[130]  Benjamin B. Kimia,et al.  On the evolution of curves via a function of curvature , 1992 .

[131]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[132]  Robert T. Schultz,et al.  Segmentation and Measurement of the Cortex from 3D MR Images , 1998, MICCAI.