Head Modeling with Camera Autocalibration and Deformation

A 3D head modeling method from a sequence of 2D images is described. The views from which the input images are acquired are not calibrated. Therefore, an auto-calibration method for a sequence of images with small rotations and translation is developed. For this purpose, we have modified an already existing auto-calibration algorithm to incorporate known aspect ratio and skew values to make it applicable for small rotation around a single axis. We apply this auto-calibration technique to head (face) modeling. Three dimensional positions of known facial features computed from two dimensional images are used to deform a generic head model by using a spring based energy minimization method.

[1]  Zhengyou Zhang,et al.  Image-based modeling of objects and human faces , 2000, IS&T/SPIE Electronic Imaging.

[2]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[3]  Pascal Fua,et al.  Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data , 2000, International Journal of Computer Vision.

[4]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[5]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[8]  O. Faugeras.  Stratification of three-dimensional vision: projective, affine, and metric representations , 1995 .

[9]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[10]  Zhengyou Zhang,et al.  Euclidean structure from uncalibrated images using fuzzy domain knowledge: application to facial images synthesis , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Olivier D. Faugeras,et al.  What can two images tell us about a third one? , 1994, ECCV.

[12]  Volkan Atalay,et al.  Projection based method for segmentation of human face and its evaluation , 2002, Pattern Recognit. Lett..

[13]  Zhengyou Zhang,et al.  Corner guided curve matching and its application to scene reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).