A Non-template Based Automatic Landmarking on 3D Face Data

The standard initial stage for the extraction of information from human face image data is the detection of key anatomical landmarks, which is a vital stage for several face recognition, facial analysis and synthesis applications. Locating facial landmarks in images is an important task in image processing, and detecting these landmarks automatically still remains a challenge. The appearance of facial landmarks may vary tremendously due to facial expressions and pose variations. Detecting and localising landmarks from raw face data are often performed manually by trained and experienced scientists or clinicians, and this process is laborious and tedious. In order to overcome these challenges, a novel non-template based automatic landmarking method on 3D face data is presented. The geometric approach is employed through utilising the surface curvatures, primitive surfaces information to detect and extract potential features. Subsequently, K-means clustering is applied to categorise and obtain the centroid of extracted features, which is later use to estimate and localise facial landmarks. The overall performance and accuracy of the proposed approach demonstrates the effectiveness and robustness of its method. Results of 95.6% of accurately locating the feature proved the effectiveness of the algorithm.

[1]  Taher Khadhraoui,et al.  A novel approach to nose-tip and eye-corners detection using HK-classification in case of 3D face analysis , 2014, 2014 World Congress on Computer Applications and Information Systems (WCCAIS).

[2]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[3]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Alberto Del Bimbo,et al.  Selecting stable keypoints and local descriptors for person identification using 3D face scans , 2014, The Visual Computer.

[5]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[6]  Yousef Farhang,et al.  Face Extraction from Image based on K-Means Clustering Algorithms , 2017 .

[7]  Federico Tombari,et al.  Performance Evaluation of 3D Keypoint Detectors , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[8]  Raimondo Schettini,et al.  3D face detection using curvature analysis , 2006, Pattern Recognit..

[9]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Alan C. Bovik,et al.  Anthropometric 3D Face Recognition , 2010, International Journal of Computer Vision.

[11]  L. Akarun,et al.  3D Facial Landmarking under Expression, Pose, and Occlusion Variations , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[12]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Liming Chen,et al.  A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[14]  L. Lo,et al.  Three-dimensional cephalometry for orthognathic planning: Normative data and analyses. , 2019, Journal of the Formosan Medical Association = Taiwan yi zhi.

[15]  Sanjay Ranka,et al.  An effic ient k-means clustering algorithm , 1997 .

[16]  S. Kreiborg,et al.  A Pilot Study on the Influence of Facial Expression on Measurements in Three-Dimensional Digital Surfaces of the Face in Infants with Cleft Lip and Palate , 2016, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[17]  Bülent Sankur,et al.  A comparative study of face landmarking techniques , 2013, EURASIP J. Image Video Process..

[18]  Pan Zheng,et al.  A functional pipeline framework for landmark identification on 3D surface extracted from volumetric data , 2017, PloS one.

[19]  A. Ayoub,et al.  "Direct DICOM Slice Landmarking” A Novel Research Technique to Quantify Skeletal Changes in Orthognathic Surgery , 2015, PloS one.

[20]  Daniel Rueckert,et al.  Evaluation of 3D Face Recognition Using Registration and PCA , 2005, AVBPA.

[21]  Liming Chen,et al.  Fully automatic 3D facial expression recognition using a region-based approach , 2011, J-HGBU '11.

[22]  Suparna Biswas,et al.  Facial Expression Recognition Using Modified Local Binary Pattern , 2015 .

[23]  Ashraf A. Kassim,et al.  Facial Landmark Detection via Progressive Initialization , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[24]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[25]  Weihong Deng,et al.  Face Feature Extraction: A Complete Review , 2018, IEEE Access.

[26]  Wen Gao,et al.  Learned local Gabor patterns for face representation and recognition , 2009, Signal Process..

[27]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.