THE INTERPLAY BETWEEN RECONSTRUCTION AND RECOGNITION

This report is concerned with understanding the interplay between 3D face reconstruction and recognition. We provide analysis for the effect of adaptive sparse 3D reconstructions on recognition rate. This work illustrates that, for 3D face recognition, a proper mesh containing nearly 2% of the facial information and about 5 times the initial/root mesh provides similar recognition rate as one with full 3D information. The report describes a systematic approach to generate adaptive meshing staring from a root mesh of basic facial landmarks. This work is a crucial first step towards a successful incorporation of 3D face recognition approaches in near real time scenarios under effects of pose and illumination.

[1]  Aly A. Farag,et al.  Variational Curve Skeletons Using Gradient Vector Flow , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Aly A. Farag,et al.  A new symmetric shape from shading algorithm with an application to 3-D face reconstruction , 2008, 2008 15th IEEE International Conference on Image Processing.

[3]  Deva Ramanan,et al.  Increasing the density of Active Appearance Models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Edwin R. Hancock,et al.  Facial Shape-from-shading and Recognition Using Principal Geodesic Analysis and Robust Statistics , 2007, International Journal of Computer Vision.

[5]  Ben A. M. Schouten,et al.  Learning a Sparse Representation from Multiple Still Images for On-Line Face Recognition in an Unconstrained Environment , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Anil K. Jain,et al.  3D Face Reconstruction from Stereo Video , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[7]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[8]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Patrick J. Flynn,et al.  A survey of approaches to three-dimensional face recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  Jan Philipp Hakenberg,et al.  Smooth Subdivision for Mixed Volumetric Meshes , 2004 .

[11]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Peter Schröder,et al.  Interpolating Subdivision for meshes with arbitrary topology , 1996, SIGGRAPH.

[13]  Fred L. Bookstein,et al.  Morphometric Tools for Landmark Data. , 1998 .

[14]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.