3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest

3D face recognition has lately been attracting ever increasing attention. In this paper we review the full spectrum of 3D face processing technology, from sensing to recognition. The review covers 3D face modelling, 3D to 3D and 3D to 2D registration, 3D based recognition and 3D assisted 2D based recognition. The fusion of 2D and 3D modalities is also addressed. The paper complements other reviews in the face biometrics area by focusing on the sensor technology, and by detailing the efforts in 3D face modelling and 3D assisted 2D face matching.

[1]  Josef Kittler,et al.  Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[3]  Andrew Zisserman,et al.  Automated visual identification of characters in situation comedies , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Shaogang Gong,et al.  Support vector regression and classification based multi-view face detection and recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[6]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[7]  Josef Kittler,et al.  A comparison of photometric normalisation algorithms for face verification , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[8]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Chin Seng Chua,et al.  Point Signatures: A New Representation for 3D Object Recognition , 1997, International Journal of Computer Vision.

[11]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Adrian Hilton,et al.  Video-rate capture of dynamic face shape and appearance , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[13]  Ahmed M. Elgammal,et al.  High Resolution Acquisition, Learning and Transfer of Dynamic 3‐D Facial Expressions , 2004, Comput. Graph. Forum.

[14]  Steven M. Seitz,et al.  Spacetime faces , 2004, ACM Trans. Graph..

[15]  Anil K. Jain,et al.  Three-dimensional model based face recognition , 2004, ICPR 2004.

[16]  Lei Zhang,et al.  Pose Invariant Face Recognition Under Arbitrary Unknown Lighting Using Spherical Harmonics , 2004, ECCV Workshop BioAW.

[17]  Patrick J. Flynn,et al.  A survey of approaches to three-dimensional face recognition , 2004, ICPR 2004.

[18]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[19]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation-principal directions for curved object recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[20]  P. Phillips,et al.  1 FACE RECOGNITION VENDOR TEST 2002 : EVALUATION REPORT , 2003 .

[21]  Peter Hammond,et al.  Dense surface point distribution models of the human face , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[22]  Luc Van Gool,et al.  Active acquisition of 3D shape for moving objects , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[23]  Nikolaos Grammalidis,et al.  Generation of 3-D head models from multiple images using ellipsoid approximation for the rear part , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[24]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[25]  Alexander M. Bronstein,et al.  Expression-Invariant 3D Face Recognition , 2003, AVBPA.

[26]  Zicheng Liu,et al.  Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach , 2004, International Journal of Computer Vision.

[27]  Lijun Yin,et al.  3D face recognition based on high-resolution 3D face modeling from frontal and profile views , 2003, WBMA '03.

[28]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Pascal Fua,et al.  Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data , 2000, International Journal of Computer Vision.

[30]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[31]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[32]  Evangelos E. Milios,et al.  Matching range images of human faces , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[33]  Jim Austin,et al.  Three-Dimensional Face Recognition Using Surface Space Combinations , 2004, BMVC.

[34]  Luc Vandendorpe,et al.  Face Authentication Competition on the BANCA Database , 2004, ICBA.

[35]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Keith Waters,et al.  Computer facial animation , 1996 .

[37]  Jan Paul Siebert,et al.  C3D™: a Novel Vision-Based 3-D Data Acquisition System , 1995 .

[38]  Tieniu Tan,et al.  Three-dimensional face recognition using geometric model , 2004, SPIE Defense + Commercial Sensing.

[39]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[40]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[41]  A-Nasser Ansari,et al.  3D face modeling using two orthogonal views and a generic face model , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[42]  Ajit Rajwade,et al.  1 3 D View-Invariant Face Recognition Using a Hierarchical Pose-Normalization Strategy , 2005 .