3D human face description: landmarks measures and geometrical features

Distance measures and geometrical features are widely used to describe faces. Generally, they are extracted punctually from landmarks, namely anthropometric reference points. The aims are various, such as face recognition, facial expression recognition, face detection, study of changes in facial morphology due to growth, or dysmorphologies. Most of the time, landmarks were extracted with the help of an algorithm or manually located on the faces. Then, measures are computed or geometrical features are extracted to perform the scope of the study. This paper is intended as a survey collecting and explaining all these features, in order to provide a structured user database of the potential parameters and their characteristics. Firstly, facial soft-tissue landmarks are defined and contextualized; then the various measures are introduced and some results are given; lastly, the most important measures are compared to identify the best one for face recognition applications.

[1]  Tieniu Tan,et al.  Automatic 3D face recognition combining global geometric features with local shape variation information , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[2]  T. Banchoff,et al.  Differential Geometry of Curves and Surfaces , 2010 .

[3]  Andrea Cavallaro,et al.  Compact Signatures for 3D Face Recognition under Varying Expressions , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[4]  T. Theoharis,et al.  Partial matching of interpose 3D facial data for face recognition , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[5]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[6]  S. C. Aung,et al.  Evaluation of the laser scanner as a surface measuring tool and its accuracy compared with direct facial anthropometric measurements. , 1995, British journal of plastic surgery.

[7]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[8]  Jeffrey C. Posnick,et al.  Anthropometric Growth Study of the Head , 1992 .

[9]  F C van Ginkel,et al.  Quantification of facial morphology using stereophotogrammetry--demonstration of a new concept. , 1996, Journal of dentistry.

[10]  Hartmut Neven,et al.  Online facial expression recognition based on personalized galleries , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[11]  Fei-Yue Wang,et al.  Guest Editorial Advanced Traveler Information Systems and Vision-Based Techniques for ITS , 2005 .

[12]  Nicu Sebe,et al.  Evaluation of Expression Recognition Techniques , 2003, CIVR.

[13]  Takeo Kanade,et al.  Facial Expression Recognition , 2011, Handbook of Face Recognition.

[14]  Rongrong Ji,et al.  Actor-independent action search using spatiotemporal vocabulary with appearance hashing , 2011, Pattern Recognit..

[15]  Nick Pears,et al.  Point-pair descriptors for 3D facial landmark localisation , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[16]  I R Munro,et al.  Surface morphology in Treacher Collins syndrome: an anthropometric study. , 1985, The Cleft palate journal.

[17]  Raymond N. J. Veldhuis,et al.  A landmark paper in face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[18]  Chiraz BenAbdelkader,et al.  Comparing and combining depth and texture cues for face recognition , 2005, Image Vis. Comput..

[19]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Chitra Dorai,et al.  COSMOS-a representation scheme for free-form surfaces , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  Michael M. Bronstein.  Expression-invariant 3D face recognition , 2008 .

[22]  Veikko Surakka,et al.  Feature-based detection of facial landmarks from neutral and expressive facial images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Alexander M. Bronstein,et al.  Expression-invariant face recognition via spherical embedding , 2005, IEEE International Conference on Image Processing 2005.

[24]  Jun Wang,et al.  Static topographic modeling for facial expression recognition and analysis , 2007, Comput. Vis. Image Underst..

[25]  Tieniu Tan,et al.  Combining local features for robust nose location in 3D facial data , 2006, Pattern Recognit. Lett..

[26]  V F Ferrario,et al.  Facial morphometry of television actresses compared with normal women. , 1995, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[27]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Christopher R Forrest,et al.  International Anthropometric Study of Facial Morphology in Various Ethnic Groups/Races , 2005, The Journal of craniofacial surgery.

[29]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[30]  J. Illingworth,et al.  Automatic landmarking of faces in 3D - ALF 3D , 2008 .

[31]  Hasan Demirel,et al.  Facial Expression Recognition Using 3D Facial Feature Distances , 2007, ICIAR.

[32]  Harry Wechsler,et al.  Detection of faces and facial landmarks using iconic filter banks , 1997, Pattern Recognit..

[33]  Karl Rohr,et al.  Development and validation of a multi-step approach to improved detection of 3D point landmarks in tomographic images , 2005, Image Vis. Comput..

[34]  B. Dorizzi,et al.  Precise Localization of Landmarks on 3D Faces using Gabor Wavelets , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[35]  Arman Savran,et al.  3D Face Recognition Benchmarks on the Bosphorus Database with Focus on Facial Expressions , 2008, BIOID.

[36]  Nicu Sebe,et al.  Semi-supervised learning for facial expression recognition , 2003, MIR '03.

[37]  Farkas Lg,et al.  Morphology of adult face after repair of isolated cleft palate in childhood. , 1972 .

[38]  Kwanghoon Sohn,et al.  3D Face Recognition Based on Facial Shape Indexes with Dynamic Programming , 2006, ICB.

[39]  Ioannis A. Kakadiaris,et al.  Automatic 3D Facial Region Retrieval from Multi-pose Facial Datasets , 2009, 3DOR@Eurographics.

[40]  Franck Davoine,et al.  Facial expression recognition and synthesis based on an appearance model , 2004, Signal Process. Image Commun..

[41]  Alexander M. Bronstein,et al.  Robust Expression-Invariant Face Recognition from Partially Missing Data , 2006, ECCV.

[42]  W. Zheng,et al.  Facial expression recognition using kernel canonical correlation analysis (KCCA) , 2006, IEEE Transactions on Neural Networks.

[43]  Chitra Dorai,et al.  Recognition of 3D free-form objects , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[44]  João M. F. Rodrigues,et al.  Multi-scale Keypoints in V1 and Face Detection , 2005, BVAI.

[45]  Reyes Enciso,et al.  Precision, repeatability and validation of indirect 3D anthropometric measurements with light-based imaging techniques , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[46]  Nicu Sebe,et al.  Authentic facial expression analysis , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[47]  D. Chorvat.  Three-dimensional measurement of human face with structured-light illumination , 2006 .

[48]  Raimondo Schettini,et al.  3D face detection using curvature analysis , 2006, Pattern Recognit..

[49]  Karl Rohr,et al.  Improving the Detection Performance in Semi-automatic Landmark Extraction , 1999, MICCAI.

[50]  Harry Wechsler,et al.  A Dynamic and Multiresolution Model of Visual Attention and Its Application to Facial Landmark Detection , 1998, Comput. Vis. Image Underst..

[51]  Zhang Mingli,et al.  Differences in Horizontal, Neoclassical Facial Canons in Chinese (Han) and North American Caucasian Populations , 1997, Aesthetic Plastic Surgery.

[52]  Roberto Cipolla,et al.  Enhancing Human Face Detection Using Motion and Active Contours , 1998, ACCV.

[53]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[54]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[55]  L. Akarun,et al.  Gabor Factor Analysis for 2D+3D Facial Landmark Localization , 2006, 2006 IEEE 14th Signal Processing and Communications Applications.

[56]  신형철.  3D face recognition with geometrically localized surface shape indexes , 2006 .

[57]  Kwanghoon Sohn,et al.  Local Feature Based 3D Face Recognition , 2005, AVBPA.

[58]  Michael G. Strintzis,et al.  Bilinear Models for 3-D Face and Facial Expression Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[59]  Albert Ali Salah,et al.  3D Facial Feature Localization for Registration , 2006, MRCS.

[60]  Ioannis A. Kakadiaris,et al.  3D-aided profile-based face recognition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[61]  Karl Rohr,et al.  Localization of anatomical point landmarks in 3D medical images by fitting 3D parametric intensity models , 2006, Medical Image Anal..

[62]  Thomas S. Huang,et al.  3D facial expression recognition based on automatically selected features , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[63]  L. Farkas,et al.  Revision of Neoclassical Facial Canons in Young Adult Afro-Americans , 2000, Aesthetic Plastic Surgery.

[64]  Takeo Kanade,et al.  Facial Expression Analysis , 2011, AMFG.

[65]  Thomas S. Huang,et al.  3D facial expression recognition based on properties of line segments connecting facial feature points , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[66]  R. Chellappa.  Introduction of New Editor-in-Chief , 2005 .

[67]  Nick Pears,et al.  Landmark Localisation in 3D Face Data , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[68]  S. Malassiotis,et al.  Expression-Compensated 3D Face Recognition with Geodesically Aligned Bilinear Models , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[69]  Edwin R. Hancock,et al.  Structural object recognition using shape-from-shading , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[70]  L. Farkas,et al.  Proportionality in Asian and North American Caucasian Faces Using Neoclassical Facial Canons as Criteria , 2002, Aesthetic Plastic Surgery.

[71]  Michael G. Strintzis,et al.  3-D Face Recognition With the Geodesic Polar Representation , 2007, IEEE Transactions on Information Forensics and Security.

[72]  Ioannis A. Kakadiaris,et al.  Using Facial Symmetry to Handle Pose Variations in Real-World 3D Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  P. Ekman.  Are there basic emotions? , 1992, Psychological review.

[74]  Bülent Sankur,et al.  Robust facial landmarking for registration , 2007, Ann. des Télécommunications.

[75]  José F. Vélez,et al.  Face recognition using 3D surface extracted descriptors , 2003 .

[76]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[77]  P. De Silva,et al.  Handbook of Cognition and Emotion , 2001 .

[78]  Michael G. Strintzis,et al.  3D facial expression recognition using swarm intelligence , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[79]  Emmanuel Dellandréa,et al.  AU recognition on 3D faces based on an extended statistical facial feature model , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[80]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Jake K. Aggarwal,et al.  3D Face Recognition Founded on the Structural Diversity of Human Faces , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[82]  Michael G. Strintzis,et al.  Bilinear elastically deformable models with application to 3D face and facial expression recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[83]  Dong-Won Shin,et al.  3D face recognition based on feature detection using active shape models , 2008, 2008 International Conference on Control, Automation and Systems.

[84]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[85]  Wu-Fan Chen,et al.  An Affine Invariant Eulidean Distance Between Images , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[86]  Karl Rohr,et al.  Localization of 3D Anatomical Point Landmarks in 3D Tomographic Images Using Deformable Models , 2000, MICCAI.

[87]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[88]  T. Dalgleish,et al.  Handbook of cognition and emotion , 1999 .

[89]  Anil K. Jain,et al.  Detection of Anchor Points for 3D Face Veri.cation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[90]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[91]  Zhili Mao,et al.  A coordinate-free method for the analysis of 3D facial change , 2004, SPIE Medical Imaging.

[92]  C. Cacou.  Anthropometry of the head and face , 1995 .

[93]  L. Farkas,et al.  Accuracy of Anthropometric Measurements: Past, Present, and Future , 1996 .

[94]  Leslie G. Farkas.  Discussion: Facial morphometry of television actresses compared with normal women , 1995 .

[95]  Ashok Samal,et al.  How effective are landmarks and their geometry for face recognition? , 2006, Comput. Vis. Image Underst..

[96]  Andrea Cavallaro,et al.  3-D Face Detection, Landmark Localization, and Registration Using a Point Distribution Model , 2009, IEEE Transactions on Multimedia.

[97]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[98]  W K Lindsay,et al.  Morphology of adult face after repair of isolated cleft palate in childhood. , 1972, The Cleft palate journal.

[99]  Alan C. Bovik,et al.  Anthropometric 3D Face Recognition , 2010, International Journal of Computer Vision.

[100]  Jun Wang,et al.  3D Facial Expression Recognition Based on Primitive Surface Feature Distribution , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[101]  Anil K. Jain,et al.  Automatic feature extraction for multiview 3D face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[102]  L. Akarun,et al.  3D Facial Landmarking under Expression, Pose, and Occlusion Variations , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[103]  Ioannis A. Kakadiaris,et al.  Profile-based 3D-aided face recognition , 2012, Pattern Recognit..

[104]  Bo Wu,et al.  Real time facial expression recognition with AdaBoost , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[105]  Karl Rohr,et al.  Multi-Step Procedures for the Localization of 2D and 3D Point Landmarks and Automatic ROI Size Selection , 1998, ECCV.

[106]  I R Munro,et al.  Craniofacial disproportions in Apert's syndrome: an anthropometric study. , 1985, The Cleft palate journal.

[107]  Yan Zhang,et al.  On the Euclidean distance of images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  Karl Rohr,et al.  Improving the Robustness in Extracting 3D Point Landmarks from 3D Medical Images Using Parametric Deformable Models , 2001, MICCAI.

[109]  Yunhong Wang,et al.  Faceprint: Fusion of Local Features for 3D Face Recognition , 2009, ICB.

[110]  L. Farkas,et al.  Photogrammetric Comparison of Two Methods for Synchronous Repair of Bilateral Cleft Lip and Nasal Deformity , 1998, Plastic and reconstructive surgery.

[111]  Alexander M. Bronstein,et al.  Face Recognition from Facial Surface Metric , 2004, ECCV.

[112]  Lijun Yin,et al.  Recognizing partial facial action units based on 3D dynamic range data for facial expression recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[113]  Marios Savvides,et al.  Automatic Facial Landmark Tracking in Video Sequences Using Kalman Filter Assisted Active Shape Models , 2010, ECCV Workshops.

[114]  H. Demirel,et al.  3D facial expression recognition with geometrically localized facial features , 2008, 2008 23rd International Symposium on Computer and Information Sciences.