Face recognition from super-resolved images

Surveillance imagery is usually lower in resolution than the capabilities of hardware owing to demands on storage and processing. Additionally, a large field of view reduces the number of pixels covered by a face even further. As this number decreases, it has been observed that face recognition performance eventually degrades considerably. Super-resolution helps overcome this by fusing complimentary information from multiples frames of video to produce higher resolution images. As many existing techniques assume rigidity of objects and simple global motion between frames, their performance suffers when applied to human faces. Optical flow can be used solve this problem by generating a dense motion field to track the inter-frame motion. This paper presents a novel optical flow based super-resolution face recognition system. Results from preliminary experiments show consistent improvement in recognition performance using super-resolved images, making the system viable for use in a surveillance environment.

[1]  Yücel Altunbasak,et al.  Eigenface-domain super-resolution for face recognition , 2003, IEEE Trans. Image Process..

[2]  Luc Van Gool,et al.  A Probabilistic Approach to Optical Flow based Super-Resolution , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[4]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[5]  J.N. Gowdy,et al.  CUAVE: A new audio-visual database for multimodal human-computer interface research , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Bruce A. Draper,et al.  The CSU Face Identification Evaluation System: Its Purpose, Features, and Structure , 2003, ICVS.

[7]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[8]  Takeo Kanade,et al.  Super-Resolution Optical Flow , 1999 .

[9]  V. Chandran,et al.  Investigation into Optical Flow Super-Resolution for Surveillance Applications , 2005 .

[10]  Marc Parizeau,et al.  Experiments on eigenfaces robustness , 2002, Object recognition supported by user interaction for service robots.

[11]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.