Sparse shape registration for occluded facial feature localization

This paper proposes a sparsity driven shape registration method for occluded facial feature localization. Most current shape registration methods search landmark locations which comply both shape model and local image appearances. However, if the shape is partially occluded, the above goal is inappropriate and often leads to distorted shape results. In this paper, we introduce an error term to rectify the locations of the occluded landmarks. Under the assumption that occlusion takes a small proportion of the shape, we propose a sparse optimization algorithm that iteratively approaches the optimal shape. The experiments in our synthesized face occlusion database prove the advantage of our method.

[1]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[2]  Timothy F. Cootes,et al.  Trainable method of parametric shape description , 1992, Image Vis. Comput..

[3]  Andrea J. van Doorn,et al.  The Structure of Locally Orderless Images , 1999, International Journal of Computer Vision.

[4]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[5]  Shaogang Gong,et al.  A Multi-View Nonlinear Active Shape Model Using Kernel PCA , 1999, BMVC.

[6]  Yuanzhong Li,et al.  Shape parameter optimization for Adaboosted active shape model , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.

[8]  A. Martínez,et al.  The AR face databasae , 1998 .

[9]  Zhi-Hua Zhou,et al.  Enhanced Pictorial Structures for precise eye localization under incontrolled conditions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Harry Shum,et al.  Face alignment using statistical models and wavelet features , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[12]  Timothy F. Cootes,et al.  A Trainable Method of Parametric Shape Description , 1991, BMVC.

[13]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Takeo Kanade,et al.  A Generative Shape Regularization Model for Robust Face Alignment , 2008, ECCV.

[15]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Alejandro F. Frangi,et al.  Active shape model segmentation with optimal features , 2002, IEEE Transactions on Medical Imaging.

[17]  Yi Zhou,et al.  Bayesian tangent shape model: estimating shape and pose parameters via Bayesian inference , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Timothy F. Cootes,et al.  A mixture model for representing shape variation , 1999, Image Vis. Comput..

[19]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[20]  Rogers,et al.  Robust Active Shape Model Search for Medical Image Analysis , 2002 .