Face detection on distorted images using perceptual quality-aware features

We quantify the degradation in performance of a popular and effective face detector when human–perceived image quality is degraded by distortions due to additive white gaussian noise, gaussian blur or JPEG compression. It is observed that, within a certain range of perceived image quality, a modest increase in image quality can drastically improve face detection performance. These results can be used to guide resource or bandwidth allocation in a communication/delivery system that is associated with face detection tasks. A new face detector based on QualHOG features is also proposed that augments face-indicative HOG features with perceptual quality–aware spatial Natural Scene Statistics (NSS) features, yielding improved tolerance against image distortions. The new detector provides statistically significant improvements over a strong baseline on a large database of face images representing a wide range of distortions. To facilitate this study, we created a new Distorted Face Database, containing face and non–face patches from images impaired by a variety of common distortion types and levels. This new dataset is available for download and further experimentation at www.ideal.ece.utexas.edu/˜suriya/DFD/.

[1]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[3]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[4]  D. Ruderman.  The statistics of natural images , 1994 .

[5]  S.A. Karunasekera,et al.  A distortion measure for image artifacts based on human visual sensitivity , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[9]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[11]  Rainer Lienhart,et al.  Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection , 2003, DAGM-Symposium.

[12]  Alessandro Neri,et al.  Blind quality assessment system for multimedia communications using tracing watermarking , 2003, IEEE Trans. Signal Process..

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  B. Martin,et al.  Quality Assessment of Facial Images , 2006, 2006 Biometrics Symposium: Special Session on Research at the Biometric Consortium Conference.

[16]  Anil K. Jain,et al.  Localized Iris Image Quality Using 2-D Wavelets , 2006, ICB.

[17]  Natalia A. Schmid,et al.  Image quality assessment for iris biometric , 2006, SPIE Defense + Commercial Sensing.

[18]  M. Abdel-Mottaleb,et al.  Application notes - Algorithms for Assessing the Quality of Facial Images , 2007, IEEE Computational Intelligence Magazine.

[19]  Sheila S. Hemami,et al.  Quantifying the use of structure in cognitive tasks , 2007, Electronic Imaging.

[20]  James M. Rehg,et al.  On the Design of Cascades of Boosted Ensembles for Face Detection , 2008, International Journal of Computer Vision.

[21]  Andrew Perkis,et al.  No-reference JPEG-image quality assessment using GAP-RBF , 2007, Signal Process..

[22]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[23]  Antonio Albiol,et al.  Face recognition using HOG-EBGM , 2008, Pattern Recognit. Lett..

[24]  Sheila S. Hemami,et al.  Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM , 2008, Electronic Imaging.

[25]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[26]  Patrick Le Callet,et al.  Image utility assessment and a relationship with image quality assessment , 2009, Electronic Imaging.

[27]  Xiang Zhu,et al.  A no-reference sharpness metric sensitive to blur and noise , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[28]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Zhengyou Zhang,et al.  A Survey of Recent Advances in Face Detection , 2010 .

[30]  Shishir K. Shah,et al.  Joint Modeling of Algorithm Behavior and Image Quality for Algorithm Performance Prediction , 2010, BMVC.

[31]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[32]  Zhou Wang,et al.  Reduced- and No-Reference Image Quality Assessment , 2011, IEEE Signal Processing Magazine.

[33]  Richard Guest,et al.  Information technology -- 29107-7 Conformance testing methodology for biometric data interchange formats defined in ISO/IEC 19794 -- Part 7: Signature/sign time series data , 2011 .

[34]  David S. Doermann,et al.  No-Reference Image Quality Assessment Using Visual Codebooks , 2012, IEEE Transactions on Image Processing.

[35]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[36]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[37]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[38]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[39]  J. Rabin.  The Retina: An Approachable Part of the Brain , 2013 .