Resolution enhancement of facial image using an error back-projection of example-based learning

This work proposes a new method of enhancing the resolution of facial image from a low-resolution facial image using a recursive error back-projection of example-based learning. A face is represented by a linear combination of prototypes of shape and texture. With the shape and texture information about the pixels in a given low-resolution facial image, we can estimate optimal coefficients for a linear combination of prototypes of shape and those of texture by solving least square minimization. Then high-resolution facial image can be obtained by using the optimal coefficients for linear combination of the high-resolution prototypes, in addition to, a recursive error back-projection is applied to improve the accuracy of resolution enhancement. The encouraging results of the proposed method show that our method can be used to improve the performance of the face recognition by applying our method to enhance the low-resolution facial images captured at visual surveillance systems.

[1]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Patrick Bouthemy,et al.  Restoration of Noisy, Blurred, Undersampled Image Sequences Using a Parametric Motion Model , 2000 .

[3]  Moon Gi Kang,et al.  Super-resolution image reconstruction , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[4]  Seong-Whan Lee,et al.  Resolution enhancement of facial image based on top-down learning , 2003, IWVS '03.

[5]  Michael J. Jones,et al.  Top–down learning of low-level vision tasks , 1997, Current Biology.

[6]  Sami Romdhani,et al.  Face identification across different poses and illuminations with a 3D morphable model , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[7]  Aggelos K. Katsaggelos,et al.  Resolution enhancement of monochrome and color video using motion compensation , 2001, IEEE Trans. Image Process..

[8]  Nikolaus F. Troje,et al.  Separation of texture and shape in images of faces for image coding and synthesis , 1997 .

[9]  Tomaso Poggio,et al.  Example Based Image Analysis and Synthesis , 1993 .

[10]  Seong-Whan Lee,et al.  Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Piotr S. Windyga,et al.  Fast impulsive noise removal , 2001, IEEE Trans. Image Process..