Face image quality assessment for face selection in surveillance video using convolutional neural networks

Automated Face Quality Assessment (FQA) plays a key role in improving face recognition accuracy and increasing computational efficiency. In the context of video, it is very common to acquire multiple face images of a single person. If one were to use all the acquired face images for the recognition task, the computational load for Face Recognition (FR) increases while recognition accuracy decreases due to outliers. This impediment necessitates a strategy to optimally choose the good quality face images from the pool of images in order to improve the performance of the FR algorithm. Toward this end, we propose a FQA algorithm that is based on mimicking the recognition capability of a given FR algorithm using a Convolutional Neural Network (CNN). In this way, we select those face images that are of high quality with respect to the FR algorithm. The proposed algorithm is simple and can be used in conjunction with any FR algorithm. Preliminary results demonstrate that the proposed method is on par with the state-of-the-art FQA methods in improving the performance of FR algorithms in a surveillance scenario.

[1]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Yu Deng,et al.  Face Image Quality Assessment Based on Learning to Rank , 2015, IEEE Signal Processing Letters.

[3]  Patrick J. Flynn,et al.  Face Recognition from Video: a Review , 2012, Int. J. Pattern Recognit. Artif. Intell..

[4]  Yongkang Wong,et al.  On robust face recognition via sparse coding: the good, the bad and the ugly , 2013, IET Biom..

[5]  Ken-ichi Maeda,et al.  Face recognition using temporal image sequence , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  Li Zi-qing Standardization of Face Image Sample Quality , 2009 .

[7]  Yongkang Wong,et al.  On robust face recognition via sparse coding: the good, the bad and the ugly , 2013, IET Biom..

[8]  Bo Wu,et al.  Face pose estimation and its application in video shot selection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[11]  Yongkang Wong,et al.  Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition , 2011, CVPR 2011 WORKSHOPS.

[12]  Yunhong Wang,et al.  Asymmetry-Based Quality Assessment of Face Images , 2009, ISVC.

[13]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[14]  Christophe Garcia,et al.  Enhancing face recognition from video sequences using robust statistics , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[15]  Stan Z. Li,et al.  Face Image Quality Evaluation for ISO/IEC Standards 19794-5 and 29794-5 , 2009, ICB.