One-shot 3D-shape and Texture Acquisition of Facial Data

In this paper we present new methods to simultaneously extract and exploit the three-dimensional shape of a face and its surface texture. It is based on an active technique, i.e. special illumination, but in contrast to traditional active sensing does not require scanning or sequential projection of multiple patterns. This one-shot nature of the devise allows to capture moving objects, e.g. for making a 3D reconstruction of a face even when the person is talking. The use of the system is illustrated using simple methods to extract both textural and geometrical features from faces, that can be used for authentication purposes. The advantage of using 3D data is that both types of features can be made more invariant under changes in head pose or illumination conditions.

[1]  Lawrence B. Wolff,et al.  On the relative brightness of specular and diffuse reflection , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Robert A. Kaucic Lip Tracking for Audio-Visual Speech Recognition. , 1997 .

[3]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Luc Van Gool,et al.  Active acquisition of 3D shape for moving objects , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[5]  Timothy F. Cootes,et al.  A unified approach to coding and interpreting face images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[6]  Andrew Blake,et al.  Real-Time Lip Tracking for Audio-Visual Speech Recognition Applications , 1996, ECCV.

[7]  Lawrence B. Wolff,et al.  Generalizing Lambert's Law for Smooth Surfaces , 1996, ECCV.

[8]  Luc Van Gool,et al.  One-shot active 3D shape acquisition , 1996, Proceedings of 13th International Conference on Pattern Recognition.