3D Face Recognition

Biometric systems for human recognition are an ongoing demand. Among all biometric technologies which are employed so far, face recognition is one of the most widely outspread biometrics. Its daily use by nearly everyone as the primary mean for recognizing other humans and its naturalness have turned face recognition into a well-accepted method. Furthermore, this image procurement is not considered as intrusive as the other mentioned alternatives. Nonetheless, in spite of the various facial recognition systems which already exist, many of them have been unsuccessful in matching up to expectations. 2D facial recognition systems are constrained by limitations such as physical appearance changes, aging factor, pose and changes in lighting intensity. Recently, to overcome these challenges 3D facial recognition systems have been issued as the newly emerged biometric technique, showing a high level of accuracy and reliability, being more robust to face variation due to the different factors. A face-based biometric system consists of acquisition devices, preprocessing, feature extraction, data storage and a comparator. An acquisition device may be a 2D-, 3Dor an infra-redcamera that can record the facial information. The preprocessing can detect facial landmarks, align facial data and crop facial area. It can filter irrelevant information such as hair, background and reduce facial variation due to pose change. In 2D images, landmarks such as eye, eyebrow, mouths etc, can be reliably detected, in contrast, nose is the most important landmark in 3D face recognition. The 3D information (depth and texture maps) corresponding to the surface of the face may be acquired using different alternatives: A multi camera system (stereoscopy), range cameras or 3D laser and scanner devices. Different approaches have been presented from the 3D perspective. The first approach would correspond to all 3D approaches that require the same data format in the training and in the testing stage. The second philosophy would enclose all approaches that take advantage of the 3D data during the training stage but then use 2D data in the recognition stage. Approaches of the first category report better results than of the second group; however, the main drawback of this category is that the acquisition conditions and elements of the test scenario should be well synchronized and controlled in order to acquire accurate 3D data. Thus, they are not suitable for surveillance applications or control access points where only one “normal” 2D texture image (from any view) acquired from a single camera is available. The second category encloses model-based approaches. Nevertheless, model-based face recognition approaches present the main drawback of a high computational burden required to fit the images to the 3D models.

[1]  Hassan Ugail,et al.  Automatic 3D Face Recognition Using Fourier Descriptors , 2009, 2009 International Conference on CyberWorlds.

[2]  Alexander M. Bronstein,et al.  Expression-Invariant Representations of Faces , 2007, IEEE Transactions on Image Processing.

[3]  Gang Hua,et al.  Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Vinod Chandran,et al.  3D Face Recognition using Log-Gabor Templates , 2006, BMVC.

[5]  Fadi Dornaika,et al.  Facial Expression Recognition using Auto-regressive Models , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Liming Chen,et al.  Automatic Asymmetric 3D-2D Face Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[7]  Antonio Rama,et al.  Face Recognition using a Fast Model Synthesis from a Profile and a Frontal View , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Andrea Cavallaro,et al.  Compact Signatures for 3D Face Recognition under Varying Expressions , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[9]  Jake K. Aggarwal,et al.  A case for the average-half-face in 2D and 3D for face recognition , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Stan Z. Li,et al.  2D–3D face matching using CCA , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[11]  Andrea Cavallaro,et al.  Region Segmentation and Feature Point Extraction on 3D Faces using a Point Distribution Model , 2007, 2007 IEEE International Conference on Image Processing.

[12]  Donghoon Kim,et al.  Face Components Detection Using SURF Descriptors and SVMs , 2008, 2008 International Machine Vision and Image Processing Conference.

[13]  Franck Davoine,et al.  Facial expression recognition and synthesis based on an appearance model , 2004, Signal Process. Image Commun..

[14]  Franck Davoine,et al.  Appearance factorization based facial expression recognition and synthesis , 2004, ICPR 2004.

[15]  Anil K. Jain,et al.  3D model-assisted face recognition in video , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[16]  Avinash C. Kak,et al.  Calculating the 3d-pose of rigid-objects using active appearance models , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[17]  Michael G. Strintzis,et al.  3-D Face Recognition With the Geodesic Polar Representation , 2007, IEEE Transactions on Information Forensics and Security.

[18]  Xin Chen,et al.  Face Recognition Using 2-D, 3-D, and Infrared: Is Multimodal Better Than Multisample? , 2006, Proceedings of the IEEE.

[19]  Daniel Rueckert,et al.  Evaluation of automatic 4D face recognition using surface and texture registration , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[20]  Li Zhang,et al.  Recognition of Non-Cooperative Individuals at a Distance with 3D Face Modeling , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[21]  Thomas Vetter,et al.  Expression invariant 3D face recognition with a Morphable Model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[22]  Antonio Rama,et al.  P/sup 2/CA: a new face recognition scheme combining 2D and 3D information , 2005, IEEE International Conference on Image Processing 2005.

[23]  Arun Ross,et al.  Face Recognition in Video: Adaptive Fusion of Multiple Matchers , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Rama Chellappa,et al.  Robust Estimation of Albedo for Illumination-invariant Matching and Shape Recovery , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Daijin Kim,et al.  Pose-Robust Facial Expression Recognition Using View-Based 2D $+$ 3D AAM , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Sami Romdhani,et al.  A 3D Face Model for Pose and Illumination Invariant Face Recognition , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[27]  Yanning Zhang,et al.  A Method Based on Geometric Invariant Feature for 3D Face Recognition , 2009, 2009 Fifth International Conference on Image and Graphics.

[28]  Takeo Kanade,et al.  Real-time combined 2D+3D active appearance models , 2004, CVPR 2004.

[29]  Iain Matthews,et al.  Passive Driver Gaze Tracking with Active Appearance Models (特集 センシング技術) , 2004 .

[30]  Wei Zeng,et al.  Partial Face Biometry Using Shape Decomposition on 2D Conformal Maps of Faces , 2010, 2010 20th International Conference on Pattern Recognition.

[31]  Wei-Yang Lin,et al.  Optimal Linear Combination of Facial Regions for Improving Identification Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Jean-Luc Dugelay,et al.  Geometric invariants for 2D/3D face recognition , 2007, Pattern Recognit. Lett..

[33]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[34]  Patrick Flynn,et al.  Multi-frame Approaches To Improve Face Recognition , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[35]  Gérard G. Medioni,et al.  Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[36]  Shaogang Gong,et al.  Constructing Facial Identity Surfaces for Recognition , 2003, International Journal of Computer Vision.

[37]  Anuj Srivastava,et al.  Three-Dimensional Face Recognition Using Shapes of Facial Curves , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Yanning Zhang,et al.  3D face representation and recognition by Intrinsic Shape Description Maps , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[39]  Jake K. Aggarwal,et al.  3D Face Recognition Founded on the Structural Diversity of Human Faces , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[41]  Lijun Yin,et al.  Multiple-View Face Tracking For Modeling and Analysis Based On Non-Cooperative Video Imagery , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Wenlong Li,et al.  3D Face Recognition Based on Local/Global Shape Description , 2009, 2009 International Conference on Information Technology and Computer Science.

[43]  Sen Wang,et al.  3D Surface Matching and Recognition Using Conformal Geometry , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[44]  Lijun Yin,et al.  3D Spatio-Temporal face recognition using dynamic range model sequences , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[45]  Lei Yunqi,et al.  3D face recognition by SURF operator based on depth image , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[46]  P.J. Flynn,et al.  Increased Resolution 3D Face Modeling and Recognition From Multiple Low Resolution Structure From Motion Models , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[47]  Myint Myint Sein,et al.  Multi triangle based automatic face recognition system by using 3D geometric face feature , 2009, 2009 IEEE Instrumentation and Measurement Technology Conference.

[48]  Yongsheng Gao,et al.  A Novel Pose Invariant Face Recognition Approach Using a 2D-3D Searching Strategy , 2010, 2010 20th International Conference on Pattern Recognition.

[49]  Ioannis A. Kakadiaris,et al.  Bidirectional relighting for 3D-aided 2D face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[50]  Jing Xiao,et al.  Real-time combined 2D+3D active appearance models , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[51]  Chi Fang,et al.  Improved 3D assisted pose-invariant face recognition , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[52]  Hassen Drira,et al.  A Riemannian analysis of 3D nose shapes for partial human biometrics , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[53]  Sridha Sridharan,et al.  3D face verification using a free-parts approach , 2008, Pattern Recognit. Lett..

[54]  Arjan Kuijper,et al.  3D Face Recognition with Local Binary Patterns , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[55]  Bruno Lévy,et al.  ABF++: fast and robust angle based flattening , 2005, TOGS.

[56]  Ralph Gross,et al.  Generic vs. person specific active appearance models , 2005, Image Vis. Comput..

[57]  Anil K. Jain,et al.  Deformation Modeling for Robust 3D Face Matching , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  Jörgen Ahlberg,et al.  CANDIDE-3 - An Updated Parameterised Face , 2001 .

[59]  Yiying Tong,et al.  Age-Invariant Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Ralph Gross,et al.  Generic vs. person specific active appearance models , 2005, Image Vis. Comput..

[61]  Qiuqi Ruan,et al.  A new scheme for 3D face recognition , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[62]  C. Beumier,et al.  3D Face Recognition , 2004, 2006 IEEE International Conference on Industrial Technology.

[63]  Yilei Xu,et al.  Pose and Illumination Invariant Face Recognition Using Video Sequences , 2007 .

[64]  Qiuqi Ruan,et al.  Learning effective features for 3D face recognition , 2010, 2010 IEEE International Conference on Image Processing.

[65]  Ioannis A. Kakadiaris,et al.  Intraclass Retrieval of Nonrigid 3D Objects: Application to Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Franck Davoine,et al.  Appearance factorization based facial expression recognition and synthesis , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[67]  Shaun J. Canavan,et al.  Face Recognition by Multi-Frame Fusion of Rotating Heads in Videos , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[68]  Rama Chellappa,et al.  Probabilistic recognition of human faces from video , 2002, Proceedings. International Conference on Image Processing.

[69]  Sridha Sridharan,et al.  Ieee Transactions on Information Forensics and Security: Special Issue on Human Detection and Recognition 1 Multi-scale Representation for 3d Face Recognition , 2022 .

[70]  Qiuqi Ruan,et al.  Robust 3D face recognition using learn correlative features , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[71]  Hasan S. Bilge,et al.  3D Face Decomposition and Region Selection Against Expression Variations , 2010, 2010 20th International Conference on Pattern Recognition.

[72]  Yanyan Chen,et al.  Research on 3D Face Recognition Algorithm , 2009, 2009 First International Workshop on Education Technology and Computer Science.

[73]  Zihan Zhou,et al.  Nearest-Subspace Patch Matching for face recognition under varying pose and illumination , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[74]  Naser Zaeri Feature extraction for 3D face recognition system , 2011, 2011 International Conference on Multimedia Computing and Systems.

[75]  Ahmed M. Elgammal,et al.  High Resolution Acquisition, Learning and Transfer of Dynamic 3‐D Facial Expressions , 2004, Comput. Graph. Forum.

[76]  Jing Xiao,et al.  Fitting a Single Active Appearance Model Simultaneously to Multiple Images , 2004, BMVC.

[77]  Luiz Velho,et al.  Automatic 3D Facial Expression Analysis in Videos , 2005, AMFG.

[78]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[79]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[81]  David J. Kriegman,et al.  Video-based face recognition using probabilistic appearance manifolds , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..