Modeling deformable human hands from medical images

This paper presents a new method for constructing an example-based deformable human hand model from medical images. Realistic animation of human hands requires good estimates of the joint structure and properly weighted skeleton-driven surface deformation. For this purpose, we propose a method based on medical images of hands in several poses. Our method consists of the following 3 steps: First, using the measured bone shapes, we estimate the link structure (joint rotation centers) and the joint angles of each scan. Second, we construct a mutually consistent polygonal mesh of all the scans. For this purpose, a polygonal mesh of one pose, the base mesh, is deformed using skeletal subspace deformation, and then fitted interactively to the measured meshes from the other scans. Finally, the hand is deformed using a weighted pose space deformation. We demonstrate results of deformable hand models consisting of 100,000 triangle meshes derived from CT scans.

[1]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[2]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[3]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[4]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[5]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[8]  Gregory M. Nielson,et al.  Scattered data modeling , 1993, IEEE Computer Graphics and Applications.

[9]  Kunihiro Chihara,et al.  Three-dimensional modeling of the human hand with motion constraints , 1999, Image Vis. Comput..

[10]  Dinesh Manocha,et al.  Fast Proximity Queries with Swept Sphere Volumes , 1999 .

[11]  In-Kwon Lee,et al.  Curve reconstruction from unorganized points , 2000, Comput. Aided Geom. Des..

[12]  Jessica K. Hodgins,et al.  Automatic Joint Parameter Estimation from Magnetic Motion Capture Data , 2023, Graphics Interface.

[13]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[14]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[15]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[16]  Cary B. Phillips,et al.  Multi-weight enveloping: least-squares approximation techniques for skin animation , 2002, SCA '02.

[17]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[18]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[19]  Hans-Peter Seidel,et al.  Construction and animation of anatomically based human hand models , 2003, SCA '03.

[20]  W. Press,et al.  Numerical Recipes in C++: The Art of Scientific Computing (2nd edn)1 Numerical Recipes Example Book (C++) (2nd edn)2 Numerical Recipes Multi-Language Code CD ROM with LINUX or UNIX Single-Screen License Revised Version3 , 2003 .

[21]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[22]  David Salesin,et al.  Modeling and Animating Realistic Faces from Images , 2002, International Journal of Computer Vision.