Face pixel detection using evidential calibration and fusion

Abstract Due to legal reasons, faces on a given image may have to be blurred. This may be achieved by combining several information sources, which may provide information at different levels of granularity; for instance face detectors return bounding boxes corresponding to assumed positions of faces, whereas skin detectors may return pixel level information. A general, well-founded and efficient approach to combining box-based information sources was recently proposed in the context of pedestrian detection. This approach relies on evidence theory to calibrate and combine sources. In this paper, we apply this approach to combine face (rather than pedestrian) detectors, in order to obtain a state-of-the-art face blurring system based on multiple detectors. Then, we propose another approach to tackle the blurring problem, which consists essentially in applying at the pixel-level the central idea – combining evidentially calibrated information sources – of the preceding box-based approach. This shift of focus induces several conceptual advantages. In addition, the proposed approach shows better performances on a classical face dataset, as well as on a more challenging one.

[1]  H. D. Brunk,et al.  AN EMPIRICAL DISTRIBUTION FUNCTION FOR SAMPLING WITH INCOMPLETE INFORMATION , 1955 .

[2]  Hung T. Nguyen,et al.  An Introduction to Random Sets , 2006 .

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Thierry Denoeux,et al.  Evidential combination of pedestrian detectors , 2014, BMVC.

[5]  Thierry Denoeux,et al.  Forecasting using belief functions: An application to marketing econometrics , 2014, Int. J. Approx. Reason..

[6]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Thierry Denux,et al.  Likelihood-based belief function: Justification and some extensions to low-quality data , 2014, Int. J. Approx. Reason..

[8]  Shigeru Akamatsu,et al.  Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Arthur P. Dempster,et al.  New Methods for Reasoning Towards PosteriorDistributions Based on Sample Data , 1966, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[10]  Hongbin Zha,et al.  Evidential calibration of binary SVM classifiers , 2016, Int. J. Approx. Reason..

[11]  Erik Learned-Miller,et al.  FDDB: A benchmark for face detection in unconstrained settings , 2010 .

[12]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Zhengyou Zhang,et al.  Improving multiview face detection with multi-task deep convolutional neural networks , 2014, IEEE Winter Conference on Applications of Computer Vision.

[14]  Guan-Chun Luh,et al.  Face detection using combination of skin color pixel detection and Viola-Jones face detector , 2014, 2014 International Conference on Machine Learning and Cybernetics.

[15]  Thierry Denoeux,et al.  Prediction of future observations using belief functions: A likelihood-based approach , 2016, Int. J. Approx. Reason..

[16]  Bianca Zadrozny,et al.  Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers , 2001, ICML.

[17]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[18]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[19]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[20]  Franck Luthon,et al.  Theory of evidence for face detection and tracking , 2012, Int. J. Approx. Reason..

[21]  Bianca Zadrozny,et al.  Transforming classifier scores into accurate multiclass probability estimates , 2002, KDD.

[22]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[24]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[25]  Stan Z. Li,et al.  Markov Random Field Models in Computer Vision , 1994, ECCV.

[26]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[27]  Shuo Yang,et al.  From Facial Parts Responses to Face Detection: A Deep Learning Approach , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  W. Pieczynski,et al.  An evidential Markovian model for data fusion and unsupervised image classification , 2000, Proceedings of the Third International Conference on Information Fusion.

[29]  J. Laurie Snell,et al.  Markov Random Fields and Their Applications , 1980 .

[30]  Hélène Soubaras.  On Evidential Markov Chains , 2010 .

[31]  Thierry Denoeux,et al.  Analysis of evidence-theoretic decision rules for pattern classification , 1997, Pattern Recognit..

[32]  Vladimir Spitsyn,et al.  Compact Convolutional Neural Network Cascade for Face Detection , 2015, ArXiv.

[33]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[34]  Parham Aarabi,et al.  Face detection using information fusion , 2007, 2007 10th International Conference on Information Fusion.

[35]  Ivan V. Bajic,et al.  Video Object Tracking in the Compressed Domain Using Spatio-Temporal Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[36]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.

[37]  Jason Brand,et al.  A comparative assessment of three approaches to pixel-level human skin-detection , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[38]  Mika Laaksonen,et al.  Using the skin locus to cope with chang-ing illumination conditions in color-based face tracking , 2000 .

[39]  M. Pietikäinen,et al.  A discriminative feature space for detecting and recognizing faces , 2004, CVPR 2004.