An Automatic Non-rigid Point Matching Method for Dense 3D Face Scans

In this paper, we present an automatic point matching method to overcome the dense point alignment of 3D face scans. We adopt TPS (thin plate spline) transformation to model the deformation of different 3D faces, because TPS is a type of non-rigid transformation with good smooth property and suitable for formulating the complexities of human facial morphology. Generally, TPS is derived from the interpolation between two sets of aligned controlling points. To obtain fully automatic point matching method, a random point selecting method is proposed to get the controlling points of 3D faces. Integrating the point generating method with an iterative closest point searching strategy, we achieve a point-to-point alignment solution for dense 3D face scans. The point matching tests on BJUT 3D face database reveal that the TPS based method has flexible shape deformation ability. Comparing with the hand-selecting controlling point method our method has better point matching accuracy and stability. It is proved that the presented method is efficient for dense point registration with non-rigid deformation.

[1]  Michael A. Greenspan,et al.  Approximate k-d tree search for efficient ICP , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[2]  Baba C. Vemuri,et al.  A robust algorithm for point set registration using mixture of Gaussians , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  R. N. Desmarais,et al.  Interpolation using surface splines. , 1972 .

[4]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[5]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Thomas Vetter,et al.  Estimating Coloured 3D Face Models from Single Images: An Example Based Approach , 1998, ECCV.

[8]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[9]  Hao Zhang,et al.  Robust 3D Shape Correspondence in the Spectral Domain , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[10]  Szymon Rusinkiewicz,et al.  Non-rigid range-scan alignment using thin-plate splines , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[11]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[13]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[14]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[15]  Peter Hammond,et al.  Automated Registration of 3D Faces using Dense Surface Models , 2003, BMVC.

[16]  Szymon Rusinkiewicz,et al.  Global non-rigid alignment of 3-D scans , 2007, SIGGRAPH 2007.

[17]  Wan Rui,et al.  An overview of medical image registration , 2003, Proceedings Fifth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2003.

[18]  Bernhard Schölkopf,et al.  Learning Dense 3D Correspondence , 2006, NIPS.

[19]  Marc Levoy,et al.  A hierarchical method for aligning warped meshes , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[20]  Yanfeng Sun,et al.  D Face Animation Based on Morphable Model ? , 2004 .

[21]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[22]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..