An efficient, scalable, and adaptable framework for solving generic systems of level-set PDEs

In the last decade, level-set methods have been actively developed for applications in image registration, segmentation, tracking, and reconstruction. However, the development of a wide variety of level-set PDEs and their numerical discretization schemes, coupled with hybrid combinations of PDE terms, stopping criteria, and reinitialization strategies, has created a software logistics problem. In the absence of an integrative design, current toolkits support only specific types of level-set implementations which restrict future algorithm development since extensions require significant code duplication and effort. In the new NIH/NLM Insight Toolkit (ITK) v4 architecture, we implemented a level-set software design that is flexible to different numerical (continuous, discrete, and sparse) and grid representations (point, mesh, and image-based). Given that a generic PDE is a summation of different terms, we used a set of linked containers to which level-set terms can be added or deleted at any point in the evolution process. This container-based approach allows the user to explore and customize terms in the level-set equation at compile-time in a flexible manner. The framework is optimized so that repeated computations of common intensity functions (e.g., gradient and Hessians) across multiple terms is eliminated. The framework further enables the evolution of multiple level-sets for multi-object segmentation and processing of large datasets. For doing so, we restrict level-set domains to subsets of the image domain and use multithreading strategies to process groups of subdomains or level-set functions. Users can also select from a variety of reinitialization policies and stopping criteria. Finally, we developed a visualization framework that shows the evolution of a level-set in real-time to help guide algorithm development and parameter optimization. We demonstrate the power of our new framework using confocal microscopy images of cells in a developing zebrafish embryo.

[1]  Benjamin Smith,et al.  Level Set Segmentation : Active Contours Without Edges Release 0 , 2009 .

[2]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[4]  Benjamin Smith,et al.  Level Set Segmentation using Coupled Active Surfaces Release 0 , 2009 .

[5]  Michael Unser,et al.  Variational B-Spline Level-Set: A Linear Filtering Approach for Fast Deformable Model Evolution , 2009, IEEE Transactions on Image Processing.

[6]  B. Vemuri,et al.  A level-set based approach to image registration , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[7]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[8]  W. Clem Karl,et al.  A Real-Time Algorithm for the Approximation of Level-Set-Based Curve Evolution , 2008, IEEE Transactions on Image Processing.

[9]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[10]  Wiro J. Niessen,et al.  Advanced Level-Set-Based Cell Tracking in Time-Lapse Fluorescence Microscopy , 2010, IEEE Transactions on Medical Imaging.

[11]  B. S. Manjunath,et al.  Graph partitioning active contours (GPAC) for image segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Christophe Zimmer,et al.  Segmenting and tracking fluorescent cells in dynamic 3-D microscopy with coupled active surfaces , 2005, IEEE Transactions on Image Processing.

[14]  Y. Chen,et al.  Image registration via level-set motion: Applications to atlas-based segmentation , 2003, Medical Image Anal..

[15]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[16]  Françoise Dibos,et al.  Image denoising through a level set approach , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[17]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[18]  David E. Breen,et al.  Surface reconstruction via contour metamorphosis: an Eulerian approach with Lagrangian particle tracking , 2005, VIS 05. IEEE Visualization, 2005..

[19]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Baba C. Vemuri,et al.  Evolutionary Fronts for Topology-Independent Shape Modeling and Recoveery , 1994, ECCV.

[21]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[22]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[23]  B. S. Manjunath,et al.  Graph Partitioning Active Contours for Knowledge-Based Geo-Spatial Segmentation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[24]  Stanley Osher,et al.  Image Denoising and Decomposition with Total Variation Minimization and Oscillatory Functions , 2004, Journal of Mathematical Imaging and Vision.

[25]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[26]  P. Surynková,et al.  Surface Reconstruction , 2010 .

[27]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[28]  Stanley Osher,et al.  REVIEW ARTICLE: Level Set Methods and Their Applications in Image Science , 2003 .

[29]  Tony F. Chan,et al.  An Active Contour Model without Edges , 1999, Scale-Space.

[30]  Baba C. Vemuri,et al.  Topology-independent shape modeling scheme , 1993, Optics & Photonics.

[31]  A. Mijiritskii,et al.  Surface reconstruction of Fe3O4(100) , 2000 .

[32]  S. Osher,et al.  A level set approach for computing solutions to incompressible two-phase flow , 1994 .

[33]  Marc Droske,et al.  A Mumford-Shah Level-Set Approach for Geometric Image Registration , 2006, SIAM J. Appl. Math..

[34]  R. Ramlau,et al.  A Mumford-Shah level-set approach for the inversion andsegmentation of SPECT/CT data , 2011 .

[35]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[36]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[37]  Anthony J. Yezzi,et al.  Fast approximate surface evolution in arbitrary dimension , 2008, SPIE Medical Imaging.

[38]  S. Osher,et al.  A PDE-Based Fast Local Level Set Method 1 , 1998 .

[39]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[40]  Denis Friboulet,et al.  Compactly Supported Radial Basis Functions Based Collocation Method for Level-Set Evolution in Image Segmentation , 2007, IEEE Transactions on Image Processing.

[41]  Denis Friboulet,et al.  A RBF-Based Multiphase Level Set Method for Segmentation in Echocardiography using the Statistics of the Radiofrequency Signal , 2007, 2007 IEEE International Conference on Image Processing.

[42]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[43]  Kishore Mosaliganti,et al.  Detection of Spatially Correlated Objects in 3D Images Using Appearance Models and Coupled Active Contours , 2009, MICCAI.

[44]  Denis Friboulet,et al.  A level set framework with a shape and motion prior for segmentation and region tracking in echocardiography , 2006, Medical Image Anal..

[45]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[46]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[47]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[48]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .