Implicit meshes for surface reconstruction

Deformable 3D models can be represented either as traditional explicit surfaces, such as triangulated meshes, or as implicit surfaces. Explicit surfaces are widely accepted because they are simple to deform and render, but fitting them involves minimizing a nondifferentiable distance function. By contrast, implicit surfaces allow fitting by minimizing a differentiate algebraic distance, but are harder to meaningfully deform and render. Here, we propose a method that combines the strength of both approaches. It relies on a technique that can turn a completely arbitrary triangulated mesh, such as one taken from the Web, into an implicit surface that closely approximates it and can deform in tandem with it. This allows both automated algorithms to take advantage of the attractive properties of implicit surfaces for fitting purposes and people to use standard deformation tools they feel comfortable for interaction and animation purposes. We demonstrate the applicability of our technique to modeling the human upper-body, including face, neck, shoulders, and ears, from noisy stereo and silhouette data.

[1]  Pascal Fua,et al.  Accurate face models from uncalibrated and ill-lit video sequences , 2004, CVPR 2004.

[2]  Brian Wyvill,et al.  Warping as a modelling tool for CSG/implicit models , 1997, Proceedings of 1997 International Conference on Shape Modeling and Applications.

[3]  Pascal Fua,et al.  Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data , 2000, International Journal of Computer Vision.

[4]  Nina Amenta,et al.  Defining point-set surfaces , 2004, ACM Trans. Graph..

[5]  David C. Gossard,et al.  Reconstruction of smooth parametric surfaces from unorganized data points , 1992 .

[6]  Pascal Fua,et al.  Articulated Soft Objects for Multiview Shape and Motion Capture , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Mathieu Desbrun,et al.  Animating soft substances with implicit surfaces , 1995, SIGGRAPH.

[8]  Frank P. Ferrie,et al.  Recovery of Volumetric Object Descriptions From Laser Rangefinder Images , 1990, ECCV.

[9]  Colin Bradley,et al.  G1 continuity of B-spline surface patches in reverse engineering , 1995, Comput. Aided Des..

[10]  Pascal Fua,et al.  Using Dirichlet Free Form Deformation to Fit Deformable Models to Noisy 3-D Data , 2002, ECCV.

[11]  FuaPascal,et al.  Implicit Meshes for Surface Reconstruction , 2006 .

[12]  Tony DeRose,et al.  Piecewise smooth surface reconstruction , 1994, SIGGRAPH.

[13]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[14]  David R. Forsey,et al.  Hierarchical B-spline refinement , 1988, SIGGRAPH.

[15]  Malcolm A. Sabin,et al.  Behaviour of recursive division surfaces near extraordinary points , 1998 .

[16]  Laurent D. Cohen,et al.  A Parametric Deformable Model to Fit Unstructured 3D Data , 1998, Comput. Vis. Image Underst..

[17]  Insung Ihm,et al.  Smoothing polyhedra using implicit algebraic splines , 1992, SIGGRAPH.

[18]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[19]  E. Catmull,et al.  Recursively generated B-spline surfaces on arbitrary topological meshes , 1978 .

[20]  Peter Schröder,et al.  Fitting subdivision surfaces , 2001, Proceedings Visualization, 2001. VIS '01..

[21]  Jean Ponce,et al.  Using Geometric Distance Fits for 3-D Object Modeling and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  R. Sibson A vector identity for the Dirichlet tessellation , 1980, Mathematical Proceedings of the Cambridge Philosophical Society.

[23]  James F. Blinn,et al.  A Generalization of Algebraic Surface Drawing , 1982, TOGS.

[24]  Alan H. Barr,et al.  Global and local deformations of solid primitives , 1984, SIGGRAPH.

[25]  Nadia Magnenat-Thalmann,et al.  Dirichlet free-form deformations and their application to hand simulation , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).

[26]  R. Plankers,et al.  Articulated soft objects for video-based body modeling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[27]  D. Levin,et al.  Mesh-Independent Surface Interpolation , 2004 .

[28]  Jules Bloomenthal,et al.  Convolution surfaces , 1991, SIGGRAPH.

[29]  Alex Pentland,et al.  Closed-form solutions for physically-based shape modeling and recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[31]  Ernest M. Stokely,et al.  Surface Parametrization and Curvature Measurement of Arbitrary 3-D Objects: Five Practical Methods , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[33]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[34]  Eben Ostby Describing free-form 3D surfaces for animation , 1987, I3D '86.

[35]  John F. Hughes,et al.  Direct manipulation of free-form deformations , 1992, SIGGRAPH.

[36]  Richard K. Beatson,et al.  Surface interpolation with radial basis functions for medical imaging , 1997, IEEE Transactions on Medical Imaging.

[37]  C. Bajaj Surface fitting using implicit algebraic surface patches , 1992 .

[38]  Matthias Eck,et al.  Automatic reconstruction of B-spline surfaces of arbitrary topological type , 1996, SIGGRAPH.

[39]  Demetri Terzopoulos,et al.  Sampling and reconstruction with adaptive meshes , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Hong Qin,et al.  Shape Reconstruction from 3D and 2D Data Using PDE-Based Deformable Surfaces , 2004, ECCV.

[41]  Pascal Fua,et al.  Accurate face models from uncalibrated and ill-lit video sequences , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[42]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[43]  Hans-Peter Seidel,et al.  Multi-level partition of unity implicits , 2003, ACM Trans. Graph..

[44]  Ioannis A. Kakadiaris,et al.  Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Sabine Coquillart,et al.  Extended free-form deformation: a sculpturing tool for 3D geometric modeling , 1990, SIGGRAPH.

[46]  Laurent D. Cohen,et al.  Introducing new deformable surfaces to segment 3D images , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  James F. O'Brien,et al.  Interpolating and approximating implicit surfaces from polygon soup , 2004, SIGGRAPH Courses.

[48]  Marc Levoy,et al.  Fitting smooth surfaces to dense polygon meshes , 1996, SIGGRAPH.

[49]  James F. O'Brien,et al.  Shape transformation using variational implicit functions , 1999, SIGGRAPH Courses.

[50]  Pascal Fua,et al.  Generic deformable implicit mesh models for automated reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[51]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[52]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Geoff Wyvill,et al.  Data structure forsoft objects , 1986, The Visual Computer.

[54]  Pascal Fua,et al.  From Multiple Stereo Views to Multiple 3-D Surfaces , 1997, International Journal of Computer Vision.

[55]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[56]  C. Bajaj The Emergence of Algebraic Curves and Surfaces in Geometric Design , 1992 .

[57]  Richard Szeliski,et al.  Surface modeling with oriented particle systems , 1992, SIGGRAPH.

[58]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[59]  Pascal Fua,et al.  Implicit meshes for modeling and reconstruction , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[60]  Richard K. Beatson,et al.  Smooth surface reconstruction from noisy range data , 2003, GRAPHITE '03.

[61]  Ingemar J. Cox,et al.  A maximum-flow formulation of the N-camera stereo correspondence problem , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[62]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..