Recognition Oriented Facial Image Quality Assessment via Deep Convolutional Neural Network

Quality of facial images significantly impacts the performance of face recognition algorithms. Being able to predict "which facial image is good for recognition" is of great importance for real application scenarios, where a sequence of facial images are always presented and one can select "the best quality" image frame for the subsequent matching and recognition task. To this end, we introduce a novel facial image quality automatic assessment framework directly targeting on "selecting better face image for better face recognition". For such as purpose, a deep convolutional neural network (DCNN) is trained to output a general facial quality metric which comprehensively considers various quality factors including brightness, contrast, blurriness, occlusion, pose etc. Based on this trained facial quality metric network, we are able to sort the input face images accordingly and "select" good face images for recognition. Our method is evaluated on the Color FERET and KinectFace face datasets. Results show that the proposed facial image quality metric network well distinguish "good" images from "bad" ones during face recognition.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Yunhong Wang,et al.  Asymmetry-Based Quality Assessment of Face Images , 2009, ISVC.

[3]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[4]  Arun Ross,et al.  Design and evaluation of photometric image quality measures for effective face recognition , 2014, IET Biom..

[5]  Sergey Bezryadin,et al.  Brightness Calculation in Digital Image Processing , 2007 .

[6]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[7]  Stan Z. Li,et al.  Face Image Quality Evaluation for ISO/IEC Standards 19794-5 and 29794-5 , 2009, ICB.

[8]  Stan Z. Li,et al.  Standardization of Face Image Sample Quality , 2007, ICB.

[9]  Jian Sun,et al.  Bayesian Face Revisited: A Joint Formulation , 2012, ECCV.

[10]  Jean-Luc Dugelay,et al.  KinectFaceDB: A Kinect Database for Face Recognition , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Bo Wu,et al.  Face pose estimation and its application in video shot selection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[12]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Thomas B. Moeslund,et al.  Face Quality Assessment System in Video Sequences , 2008, BIOID.