3D Face recognition by ICP-based shape matching

In this paper, we propose a novel face recognition approach based on 2.5D/3D shape matching. While most of existing methods use facial intensity image, we aim to develop a method using three-dimensional information of the human face. This is the main innovation of our technology. In our approach, the 3D dimensional information is introduced in order to overcome classical face recognition problems which are pose, illumination and facial expression variations. The paradigm is to build a 3D face gallery using a laser-based scanner: the off-line stage. In the on-line stage, the recognition, we capture one 2.5D face model at any view point and with any facial expressions. Our processing allows the identification of the presented person by performing the captured model with all faces from the database. Here, the Iterative Closest Point-based matching algorithm provides the pose of the probe whereas the region-based metric provides a spatial deviation between the probe and each face from the gallery. In this metric, we calculate the global recognition score as a weighted sum of region-based distances already labelled as mimic or static regions. For automatic 3D face segmentation, we use an immersion version of watershed segmentation algorithm. This paper also presents some experiments in order to shown illumination, pose and facial expression compensations.

[1]  Behrooz Kamgar-Parsi,et al.  Face Recognition with 3D Model-Based Synthesis , 2004, ICBA.

[2]  Anil K. Jain,et al.  Deformation Analysis for 3D Face Matching , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[3]  Anil K. Jain,et al.  Integrating Range and Texture Information for 3D Face Recognition , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[4]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Patrick J. Flynn,et al.  Effects on facial expression in 3D face recognition , 2005, SPIE Defense + Commercial Sensing.

[6]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Zhaohui Wu,et al.  3d Face Recognition from Range Data , 2005, Int. J. Image Graph..

[8]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jim Austin,et al.  Three-dimensional face recognition: an eigensurface approach , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[10]  Liming Chen,et al.  Face detection in video using combined data-mining and histogram based skin-color model , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.

[11]  Alexander M. Bronstein,et al.  Expression-Invariant 3D Face Recognition , 2003, AVBPA.

[12]  Marc Acheroy,et al.  Face verification from 3D and grey level clues , 2001, Pattern Recognit. Lett..

[13]  Liming Chen,et al.  Face Image Encription and Reconstruction for Smart Cards Using Fourrier-Melin Transform , 2004 .

[14]  Liming Chen,et al.  3D Face Modeling Based on Structured-Light Assisted Stereo Sensor , 2005, ICIAP.

[15]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Michael G. Strintzis,et al.  Pose and illumination compensation for 3D face recognition , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[17]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Tieniu Tan,et al.  Depth vs. intensity: which is more important for face recognition? , 2004, ICPR 2004.

[19]  Surendra Ranganath,et al.  Pose-invariant face recognition using a 3D deformable model , 2003, Pattern Recognit..