Minimal Surfaces Extend Shortest Path Segmentation Methods to 3D

Shortest paths have been used to segment object boundaries with both continuous and discrete image models. Although these techniques are well defined in 2D, the character of the path as an object boundary is not preserved in 3D. An object boundary in three dimensions is a 2D surface. However, many different extensions of the shortest path techniques to 3D have been previously proposed in which the 3D object is segmented via a collection of shortest paths rather than a minimal surface, leading to a solution which bears an uncertain relationship to the true minimal surface. Specifically, there is no guarantee that a minimal path between points on two closed contours will lie on the minimal surface joining these contours. We observe that an elegant solution to the computation of a minimal surface on a cellular complex (e.g., a 3D lattice) was given by Sullivan. Sullivan showed that the discrete minimal surface connecting one or more closed contours may be found efficiently by solving a minimum-cost circulation network flow (MCNF) problem. In this work, we detail why a minimal surface properly extends a shortest path (in the context of a boundary) to three dimensions, present Sullivan's solution to this minimal surface problem via an MCNF calculation, and demonstrate the use of these minimal surfaces on the segmentation of image data.

[1]  William J. Cook,et al.  Combinatorial optimization , 1997 .

[2]  N. Biggs Algebraic Graph Theory: The multiplicative expansion , 1974 .

[3]  Claudio Mattiussi,et al.  The Finite Volume, Finite Difference, and Finite Elements Methods as Numerical Methods for Physical Field Problems , 2000 .

[4]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Wei-Kuan Shih,et al.  Unifying Maximum Cut and Minimum Cut of a Planar Graph , 1990, IEEE Trans. Computers.

[6]  Enzo Tonti,et al.  On the Geometrical Structure of Electromagnetism , 1999 .

[7]  R. Ho Algebraic Topology , 2022 .

[8]  V. Kolmogorov Primal-dual Algorithm for Convex Markov Random Fields , 2005 .

[9]  J. Tsitsiklis,et al.  Efficient algorithms for globally optimal trajectories , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[10]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[11]  Leo Grady,et al.  Computing Exact Discrete Minimal Surfaces: Extending and Solving the Shortest Path Problem in 3D with Application to Segmentation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Laurent D. Cohen,et al.  Grouping connected components using minimal path techniques. Application to reconstruction of vessels in 2D and 3D images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Michael F. Cohen,et al.  Minimal Surfaces for Stereo , 2002, ECCV.

[14]  Armin Kanitsar,et al.  Semi-Automatic Topology Independent Contour-Based 2 1/2 D Segmentation Using Live-Wire , 2004, WSCG.

[15]  D. R. Fulkerson,et al.  A primal‐dual algorithm for the capacitated Hitchcock problem , 1957 .

[16]  Vladimir Kolmogorov,et al.  Computing geodesics and minimal surfaces via graph cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Majid Mirmehdi,et al.  A shortest path representation for video summarisation , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[18]  D. R. Fulkerson,et al.  Flows in Networks. , 1964 .

[19]  Heinz-Otto Peitgen,et al.  Local-cost computation for efficient segmentation of 3D objects with live wire , 2001, SPIE Medical Imaging.

[20]  Robert E. Tarjan,et al.  Network Flow Algorithms , 1989 .

[21]  Heinz-Otto Peitgen,et al.  Efficient Semiautomatic Segmentation of 3D Objects in Medical Images , 2000, MICCAI.

[22]  Hugues Talbot,et al.  Globally minimal surfaces by continuous maximal flows , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Carrick Detweiler,et al.  Expected Shortest Paths for Landmark-Based Robot Navigation , 2004, Int. J. Robotics Res..

[24]  Laurent D. Cohen,et al.  Global Minimum for Active Contour Models: A Minimal Path Approach , 1997, International Journal of Computer Vision.

[25]  J. Schiff Wiley‐Interscience Series in Discrete Mathematics and Optimization , 2011 .

[26]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[27]  Ghassan Hamarneh,et al.  3D live-wire-based semi-automatic segmentation of medical images , 2005, SPIE Medical Imaging.

[28]  Masao Iri,et al.  Comments on F. Hadlock's Paper: "Finding a Maximum Cut of a Planar Graph in Polynomial Time" , 1977, SIAM J. Comput..

[29]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[30]  Frank Morgan,et al.  Geometric Measure Theory: A Beginner's Guide , 1988 .

[31]  Siam J. CoMPtrr,et al.  FINDING A MAXIMUM CUT OF A PLANAR GRAPH IN POLYNOMIAL TIME * , 2022 .

[32]  S. Wylie,et al.  Homology Theory by P. J. Hilton , 1960 .

[33]  Laurent D. Cohen,et al.  A New Implicit Method for Surface Segmentation by Minimal Paths: Applications in 3D Medical Images , 2005, EMMCVPR.

[34]  Dirk Bartz,et al.  Live-Wire Revisited , 2005, Bildverarbeitung für die Medizin.

[35]  Frank Morgan CHAPTER 1 – Geometric Measure Theory , 1995 .

[36]  Laurent D. Cohen,et al.  Grouping Connected Components using Minimal Path Techniques , 2002 .

[37]  Jürgen Hesser,et al.  3D live-wires on pre-segmented volume data , 2005, SPIE Medical Imaging.

[38]  Jayaram K. Udupa,et al.  A 3D generalization of user-steered live-wire segmentation , 2000, Medical Image Anal..

[39]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[40]  Steven J. Gortler,et al.  Minimal discrete curves and surfaces , 2004 .

[41]  Changming Sun,et al.  Fast optical flow using 3D shortest path techniques , 2002, Image Vis. Comput..

[42]  Ingemar J. Cox,et al.  A maximum-flow formulation of the N-camera stereo correspondence problem , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[43]  E. Felten,et al.  A Crystalline Approximation Theorem for Hypersurfaces , 1990 .

[44]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  William A. Barrett,et al.  Interactive segmentation of image volumes with Live Surface , 2007, Comput. Graph..

[46]  Vladimir Kolmogorov,et al.  Minimizing Nonsubmodular Functions with Graph Cuts-A Review , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Laurent D. Cohen,et al.  Fast Constrained Surface Extraction by Minimal Paths , 2006, International Journal of Computer Vision.

[48]  Klaus Truemper,et al.  Algebraic Characterizations of Unimodular Matrices , 1978 .

[49]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[50]  Carrick Detweiler,et al.  Expected Shortest Paths for Landmark-Based Robot Navigation , 2004, Int. J. Robotics Res..

[51]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988 .

[53]  William A. Barrett,et al.  Live Surface , 2006, VG@SIGGRAPH.

[54]  S. Wylie,et al.  Homology Theory: HOMOLOGY THEORY OF POLYHEDRA , 1960 .

[55]  Mie Sato,et al.  Penalized-Distance Volumetric Skeleton Algorithm , 2001, IEEE Trans. Vis. Comput. Graph..