Modeling 3D objects from range maps and color images using a warping- based approach

In this paper we describe a new method for the modeling of objects with know generic shape such as human faces from video and range data. The method combines the strengths of active laser scanning and passive Shape from Motion techniques. Our approach consists of first reconstructing a few feature-points that can be reliably tracked throughout a video sequence of the object. These features are mapped to corresponding 3D points in a generic 3D model reconstructed from dense and accurate range data acquired only once. The resulting 3D-3D set of matches is used to warp the generic model into the actual object visible in the video stream using thin-plate splines interpolation. Our method avoids the problems of dense matching encountered in stereo algorithms. Furthermore, in the case of face reconstruction, this method provides dense models while not requiring the invasive laser scanning of faces.

[1]  F. Bookstein.  Thin-plate splines and decomposition of deformation , 1989 .

[2]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[3]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[4]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[5]  Andrew W. Fitzgibbon,et al.  VHS to VRML: 3D graphical models from video sequences , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[6]  Alex Pentland,et al.  3D structure from 2D motion , 1999, IEEE Signal Process. Mag..

[7]  Mitra Tzi - ker ChiuehComputer S ien e DepartmentState.  Three-Dimensional Computer , 2000 .

[8]  Shihong Lao,et al.  Building 3D facial models and detecting face pose in 3D space , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[9]  Paola Campadelli,et al.  Robust identification and matching of fiducial points for the reconstruction of 3D human faces from raw video sequences , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[10]  Y. Sumi,et al.  Building 3D facial models and detecting face pose in 3D space , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[11]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[12]  Seong-Whan Lee,et al.  Face reconstruction with a morphable face model , 2002, Object recognition supported by user interaction for service robots.

[13]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[14]  Rama Chellappa,et al.  3D face reconstruction from video using a generic model , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.