A new framework for 3D face reconstruction for self-occluded images

Human heads are three-dimensional objects in 3D space with variations in position and in its structure. Consequently, 3D face modelling is largely acknowledged in face recognition application for uncooperative subjects. Structure from motion SfM, 3D face reconstruction technique model a 3D facial shape by means of multiple 2D images sequence. In view of self-occluded 2D face image, this technique is susceptible to point correspondence error reducing its performance. To eliminate point correspondence error a matrix called shape conversion matrix SCM is appraised to obtain the true location of self-occluded facial feature points FFPs. In the proposed system, a new SfM method called multi-stage linear approach is adopted. A novel face alignment algorithm called RASL is incorporated with the system. A more resourceful feature localisation technique called simultaneous inverse compositional algorithm is modified. A generalised polycube trivariant spline-based 3D dense mean model adaptation is integrated. By applying these methods, a proficient framework for robust 3D face reconstruction for self-occlusion is proposed in this paper.

[1]  Rainer Stiefelhagen,et al.  Pose Normalization for Local Appearance-Based Face Recognition , 2009, ICB.

[2]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[3]  Wen Gao,et al.  Efficient 3D reconstruction for face recognition , 2005, Pattern Recognit..

[4]  Richard Szeliski,et al.  A Multi-stage Linear Approach to Structure from Motion , 2010, ECCV Workshops.

[5]  João Paulo Costeira,et al.  Estimating 3D shape from degenerate sequences with missing data , 2009, Comput. Vis. Image Underst..

[6]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[7]  Sami Romdhani,et al.  Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions , 2002, ECCV.

[8]  David Beymer,et al.  Face recognition under varying pose , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Georgios D. Evangelidis,et al.  An enhanced correlation-based method for stereo correspondence with subpixel accuracy , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Harry Shum,et al.  Review of image-based rendering techniques , 2000, Visual Communications and Image Processing.

[11]  L. Akarun,et al.  A 3D Face Recognition System for Expression and Occlusion Invariance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[12]  Hong Qin,et al.  Generalized PolyCube Trivariate Splines , 2010, 2010 Shape Modeling International Conference.

[13]  Takeo Kanade,et al.  Face Recognition Across Pose and Illumination , 2011, Handbook of Face Recognition.

[14]  Anil K. Jain,et al.  3D Model-Based Face Recognition in Video , 2007, ICB.

[15]  Shiqian Ma,et al.  Fixed point and Bregman iterative methods for matrix rank minimization , 2009, Math. Program..

[16]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[17]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[18]  Gérard G. Medioni,et al.  Model-Assisted 3D Face Reconstruction from Video , 2007, AMFG.

[19]  Timothy F. Cootes,et al.  A Multi-Stage Approach to Facial Feature Detection , 2004, BMVC.

[20]  A-Nasser Ansari,et al.  3D face modeling using two views and a generic face model with application to 3D face recognition , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[21]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Alex Pentland,et al.  A simple algorithm for shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Chun-Jen Chen,et al.  3D face recognition system , 2010, 2010 IEEE Instrumentation & Measurement Technology Conference Proceedings.

[24]  Hong Qin,et al.  Polycube splines , 2008, Comput. Aided Des..

[25]  Kang Ryoung Park,et al.  A SfM-based 3D face reconstruction method robust to self-occlusion by using a shape conversion matrix , 2011, Pattern Recognit..

[26]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).