Non-rigid 3D face shape reconstruction using a genetic algorithm

This paper proposes a method for reconstructing non-rigid 3D shapes from noisy 2D shapes. The proposed method estimates the 3D shape bases and projection matrices, exploiting low-rank constraints. Then the method finds the optimal coefficients for linear combinations of 3D shape bases to represent non-rigid 3D shapes using a genetic algorithm, and refines the 3D shape bases and the projection matrices using gradient descent techniques. The method reconstructed correct non-rigid 3D shapes in the presence of noise. The results can be used in many areas including animation, motion capture and non-rigid 3D object tracking.

[1]  M. Akca.  GENERALIZED PROCRUSTES ANALYSIS AND ITS APPLICATIONS IN PHOTOGRAMMETRY , 2003 .

[2]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[3]  Jing Xiao,et al.  A Closed-Form Solution to Non-rigid Shape and Motion Recovery , 2004, ECCV.

[4]  Iain Matthews,et al.  On the Dimensionality of Deformable Face Models , 2006 .

[5]  Henning Biermann,et al.  Recovering non-rigid 3D shape from image streams , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  D. T. Lee,et al.  Two algorithms for constructing a Delaunay triangulation , 1980, International Journal of Computer & Information Sciences.

[7]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[8]  Lorenzo Torresani,et al.  Tracking and modeling non-rigid objects with rank constraints , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..