Robust and Efficient Implicit Surface Reconstruction for Point Clouds Based on Convexified Image Segmentation

We present an implicit surface reconstruction algorithm for point clouds. We view the implicit surface reconstruction as a three dimensional binary image segmentation problem that segments the entire space $$\mathbb R ^3$$ or the computational domain into an interior region and an exterior region while the boundary between these two regions fits the data points properly. The key points with using an image segmentation formulation are: (1) an edge indicator function that gives a sharp indicator of the surface location, and (2) an initial image function that provides a good initial guess of the interior and exterior regions. In this work we propose novel ways to build both functions directly from the point cloud data. We then adopt recent convexified image segmentation models and fast computational algorithms to achieve efficient and robust implicit surface reconstruction for point clouds. We test our methods on various data sets that are noisy, non-uniform, and with holes or with open boundaries. Moreover, comparisons are also made to current state of the art point cloud surface reconstruction techniques.

[1]  Les A. Piegl,et al.  The NURBS book (2nd ed.) , 1997 .

[2]  Pierre Alliez,et al.  Signing the Unsigned: Robust Surface Reconstruction from Raw Pointsets , 2010, Comput. Graph. Forum.

[3]  M. Gross,et al.  Algebraic point set surfaces , 2007, SIGGRAPH 2007.

[4]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[5]  Hans-Peter Seidel,et al.  A multi-scale approach to 3D scattered data interpolation with compactly supported basis functions , 2003, 2003 Shape Modeling International..

[6]  Daniel Cohen-Or,et al.  Competing Fronts for Coarse–to–Fine Surface Reconstruction , 2006, Comput. Graph. Forum.

[7]  Xavier Bresson,et al.  Active Contours Based on Chambolle's Mean Curvature Motion , 2007, 2007 IEEE International Conference on Image Processing.

[8]  C. Zach Fast and High Quality Fusion of Depth Maps , 2008 .

[9]  D. F. Rogers,et al.  An Introduction to NURBS: With Historical Perspective , 2011 .

[10]  Jean-Daniel Boissonnat,et al.  Geometric structures for three-dimensional shape representation , 1984, TOGS.

[11]  James F. O'Brien,et al.  Interpolating and approximating implicit surfaces from polygon soup , 2005, SIGGRAPH 2005.

[12]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[13]  Leif Kobbelt,et al.  Robust reconstruction of watertight 3D models from non-uniformly sampled point clouds without normal information , 2006, SGP '06.

[14]  Leonidas J. Guibas,et al.  Euclidean skeletons using closest points , 2011 .

[15]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[16]  Markus H. Gross,et al.  Shape modeling with point-sampled geometry , 2003, ACM Trans. Graph..

[17]  Marc Alexa,et al.  Interpolatory point set surfaces—convexity and Hermite data , 2009, TOGS.

[18]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[19]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[20]  Xavier Bresson,et al.  Geometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction , 2010, J. Sci. Comput..

[21]  Horst Bischof,et al.  A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Marc Alexa,et al.  Anisotropic point set surfaces , 2006, AFRIGRAPH '06.

[23]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[24]  Leonidas J. Guibas,et al.  Uncertainty and Variability in Point Cloud Surface Data , 2004, PBG.

[25]  Jean-Michel Morel,et al.  Scale Space Meshing of Raw Data Point Sets , 2011, Comput. Graph. Forum.

[26]  AlexaMarc,et al.  Interpolatory point set surfacesconvexity and Hermite data , 2009 .

[27]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[28]  Mingqiang Zhu,et al.  An Efficient Primal-Dual Hybrid Gradient Algorithm For Total Variation Image Restoration , 2008 .

[29]  Yu Wang,et al.  Reconstructing Open Surfaces via Graph-Cuts , 2013, IEEE Transactions on Visualization and Computer Graphics.

[30]  J. Sethian Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[31]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[32]  Christopher Zach,et al.  High-Performance Multi-View Reconstruction , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[33]  Jian Liang,et al.  Point Cloud Segmentation and Denoising via Constrained Nonlinear Least Squares Normal Estimates , 2013, Innovations for Shape Analysis, Models and Algorithms.

[34]  James F. O'Brien,et al.  Spectral surface reconstruction from noisy point clouds , 2004, SGP '04.

[35]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[36]  Holger Wendland,et al.  Fast evaluation of radial basis functions : methods based on partition of unity , 2002 .

[37]  Xue-Cheng Tai,et al.  Global Minimization for Continuous Multiphase Partitioning Problems Using a Dual Approach , 2011, International Journal of Computer Vision.

[38]  F. Durand,et al.  Robust Higher-Order Filtering of Points , 2004 .

[39]  R. Marino,et al.  Equivalence of Nonlinear Systems to Input-Output Prime Forms , 1994 .

[40]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[41]  Pierre Alliez,et al.  Eurographics Symposium on Geometry Processing (2007) Voronoi-based Variational Reconstruction of Unoriented Point Sets , 2022 .

[42]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[43]  Los Angeles,et al.  Dual Methods for Total Variation-Based Image , 2001 .

[44]  S. Osher,et al.  Regular Article: A PDE-Based Fast Local Level Set Method , 1999 .

[45]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[46]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[47]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[48]  H. Fédérer Geometric Measure Theory , 1969 .

[49]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[50]  Stanley Bak,et al.  Some Improvements for the Fast Sweeping Method , 2010, SIAM J. Sci. Comput..

[51]  Stanley Osher,et al.  Implicit and Nonparametric Shape Reconstruction from Unorganized Data Using a Variational Level Set Method , 2000, Comput. Vis. Image Underst..

[52]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[53]  S. Osher,et al.  Implicit, Nonparametric Shape Reconstruction from Unorganized Points Using A Variational Level Set M , 1998 .

[54]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[55]  Herbert Edelsbrunner,et al.  Shape Reconstruction with Delaunay Complex , 1998, LATIN.

[56]  F. Almgren Review: Enrico Giusti, Minimal surfaces and functions of bounded variation , 1987 .

[57]  Victor S. Lempitsky,et al.  Global Optimization for Shape Fitting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[58]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[59]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1994, ACM Trans. Graph..

[60]  Markus H. Gross,et al.  Feature Preserving Point Set Surfaces based on Non‐Linear Kernel Regression , 2009, Comput. Graph. Forum.

[61]  Tony F. Chan,et al.  Aspects of Total Variation Regularized L[sup 1] Function Approximation , 2005, SIAM J. Appl. Math..

[62]  Hongkai Zhao,et al.  A fast sweeping method for Eikonal equations , 2004, Math. Comput..

[63]  David Eppstein,et al.  The Crust and the beta-Skeleton: Combinatorial Curve Reconstruction , 1998, Graph. Model. Image Process..

[64]  S. Osher,et al.  A PDE-Based Fast Local Level Set Method 1 , 1998 .

[65]  L. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communications.

[66]  N. Amenta,et al.  Defining point-set surfaces , 2004, SIGGRAPH 2004.

[67]  Vladimir Kolmogorov,et al.  Computing geodesics and minimal surfaces via graph cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[68]  David F. Rogers,et al.  An Introduction to NURBS , 2000 .

[69]  Richard K. Beatson,et al.  Surface interpolation with radial basis functions for medical imaging , 1997, IEEE Transactions on Medical Imaging.

[70]  S. Osher,et al.  Fast surface reconstruction using the level set method , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[71]  Markus H. Gross,et al.  Efficient simplification of point-sampled surfaces , 2002, IEEE Visualization, 2002. VIS 2002..

[72]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[73]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[74]  Mi-Suen Lee,et al.  A Computational Framework for Segmentation and Grouping , 2000 .

[75]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[76]  E. Giusti Minimal surfaces and functions of bounded variation , 1977 .

[77]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[78]  L. Velho,et al.  Point Cloud Denoising , 2003 .

[79]  Y. Tsai Rapid and accurate computation of the distance function using grids , 2002 .

[80]  Guy Gilboa,et al.  Nonlinear Inverse Scale Space Methods for Image Restoration , 2005, VLSM.

[81]  F. Almgren,et al.  Curvature-driven flows: a variational approach , 1993 .

[82]  R. Courant,et al.  On the Partial Difference Equations, of Mathematical Physics , 2015 .

[83]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[84]  BaeEgil,et al.  Global Minimization for Continuous Multiphase Partitioning Problems Using a Dual Approach , 2011 .

[85]  Kalpathi R. Subramanian,et al.  Interpolating implicit surfaces from scattered surface data using compactly supported radial basis functions , 2001, Proceedings International Conference on Shape Modeling and Applications.

[86]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[87]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[88]  Marc Alexa,et al.  On Normals and Projection Operators for Surfaces Defined by Point Sets , 2004, PBG.

[89]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[90]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004 .