The depth estimation of 3D face from single 2D picture based on manifold learning constraints

The estimation of depth is virtual important in 3D face reconstruction. In this paper, we propose a t-SNE based on manifold learning constraints and introduce K-means method to divide the original database into several subset, and the selected optimal subset to reconstruct the 3D face depth information can greatly reduce the computational complexity. Firstly, we carry out the t-SNE operation to reduce the key feature points in each 3D face model from 1×249 to 1×2. Secondly, the K-means method is applied to divide the training 3D database into several subset. Thirdly, the Euclidean distance between the 83 feature points of the image to be estimated and the feature point information before the dimension reduction of each cluster center is calculated. The category of the image to be estimated is judged according to the minimum Euclidean distance. Finally, the method Kong D will be applied only in the optimal subset to estimate the depth value information of 83 feature points of 2D face images. Achieving the final depth estimation results, thus the computational complexity is greatly reduced. Compared with the traditional traversal search estimation method, although the proposed method error rate is reduced by 0.49, the number of searches decreases with the change of the category. In order to validate our approach, we use a public database to mimic the task of estimating the depth of face images from 2D images. The average number of searches decreased by 83.19%.

[1]  Yaxin Bi,et al.  KNN Model-Based Approach in Classification , 2003, OTM.

[2]  Jörgen Ahlberg,et al.  CANDIDE-3 - An Updated Parameterised Face , 2001 .

[3]  Yang Yang,et al.  Effective 3D face depth estimation from a single 2D face image , 2016, 2016 16th International Symposium on Communications and Information Technologies (ISCIT).

[4]  Sami Romdhani,et al.  A 3D Face Model for Pose and Illumination Invariant Face Recognition , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[5]  Jörgen Ahlberg AN UPDATED PARAMETERISED FACE , 2001 .

[6]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jian Sun,et al.  Face Alignment by Explicit Shape Regression , 2012, International Journal of Computer Vision.

[8]  Jingqi Yan,et al.  3D Shapes Isometric Deformation Using in-tSNE , 2015, ICIG.

[9]  Chun Chen,et al.  Three-Dimensional Face Reconstruction From a Single Image by a Coupled RBF Network , 2012, IEEE Transactions on Image Processing.

[10]  Edilson de Aguiar,et al.  3D Face Reconstruction from Video Using 3D Morphable Model and Silhouette , 2014, 2014 27th SIBGRAPI Conference on Graphics, Patterns and Images.

[11]  William A. P. Smith,et al.  A Linear Approach to Face Shape and Texture Recovery using a 3D Morphable Model , 2010, BMVC.

[12]  R. Basri,et al.  Statistical Symmetric Shape from Shading for 3D Structure Recovery of Faces , 2004, eccv 2004.

[13]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..