Fitting solid meshes to animated surfaces using linear elasticity

Computing correspondence between time frames of a time-dependent 3D surface is essential for the understanding of its motion and deformation. In particular, it can be a useful tool in compression, editing, texturing, or analysis of the physical or structural properties of deforming objects. However, correspondence information is not trivial to obtain for experimentally acquired 3D animations, such as time-dependent visual hulls (typically represented as either a binary occupancy grid or as a sequence of meshes of varying connectivity). In this article we present a new nonrigid fitting method that can compute such correspondence information for objects that do not undergo large volume or topological changes, such as living creatures. Experimental results show that it is robust enough to handle visual hull data, allowing to convert it into a constant connectivity mesh with vertices moving in time. Our procedure first creates a rest-state mesh from one of the input frames. This rest-state mesh is then fitted to the consecutive frames. We do this by iteratively displacing its vertices so that a combination of surface distance and elastic potential energy is minimized. A novel rotation compensation method enables us to obtain high-quality results with linear elasticity, even in presence of significant bending.

[1]  Gregory M. Nielson,et al.  Interval volume tetrahedrization , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[2]  John F. Canny,et al.  Real-time and physically realistic simulation of global deformation , 1999, SIGGRAPH '99.

[3]  Kun Zhou,et al.  Large mesh deformation using the volumetric graph Laplacian , 2005, ACM Trans. Graph..

[4]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[5]  Leonard McMillan,et al.  Simplification and improvement of tetrahedral models for simulation , 2004, SGP '04.

[6]  Ronald Fedkiw,et al.  A Crystalline, Red Green Strategy for Meshing Highly Deformable Objects with Tetrahedra , 2003, IMR.

[7]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[9]  Paresh Parikh,et al.  Generation of three-dimensional unstructured grids by the advancing-front method , 1988 .

[10]  Mark S. Shephard,et al.  Automatic three‐dimensional mesh generation by the finite octree technique , 1984 .

[11]  Jovan Popovic,et al.  Continuous capture of skin deformation , 2003, ACM Trans. Graph..

[12]  Irfan A. Essa,et al.  Novel Skeletal Representation for Articulated Creatures , 2004, ECCV.

[13]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[14]  S. Sutharshana,et al.  Automatic three-dimensional mesh generation by the modified-octree technique: Yerry M A and Shepard, M SInt. J. Numer. Methods Eng. Vol 20 (1984) pp 1965–1990 , 1985 .

[15]  Demetri Terzopoulos,et al.  A finite element model for 3D shape reconstruction and nonrigid motion tracking , 1993, 1993 (4th) International Conference on Computer Vision.

[16]  Irfan A. Essa,et al.  Element-Free Elastic Models for Volume Fitting and Capture , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Marc Alexa,et al.  As-rigid-as-possible shape interpolation , 2000, SIGGRAPH.

[18]  Adrian Hilton,et al.  Reconstruction of Animated Models from Images Using Constrained Deformable Surfaces , 2002, DGCI.

[19]  A. Rassineux,et al.  GENERATION AND OPTIMIZATION OF TETRAHEDRAL MESHES BY ADVANCING FRONT TECHNIQUE , 1998 .

[20]  Jonathan Richard Shewchuk,et al.  Tetrahedral mesh generation by Delaunay refinement , 1998, SCG '98.

[21]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[22]  J. Canny,et al.  Real-time simulation of physically realistic global deformations , 2000 .

[23]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[24]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[25]  Leonard McMillan,et al.  Stable real-time deformations , 2002, SCA '02.

[26]  Joachim Schöberl,et al.  NETGEN An advancing front 2D/3D-mesh generator based on abstract rules , 1997 .

[27]  J. Canny,et al.  Real-time Simulation of Physically Realistic Global Deformation , 1999 .

[28]  Herbert Edelsbrunner,et al.  An Experimental Study of Sliver Exudation , 2002, Engineering with Computers.