Safeguarding Privacy by Reliable Automatic Blurring of Faces in Mobile Mapping Images

When capturing images in the wild containing pedestrians, privacy issues remain a major concern for industrial applications. Our application, collecting cycloramic mobile mapping data in crowded environments, is an example of this. If the data is processed and accessed by third parties, privacy of pedestrians must be ensured. This is where pedestrian detectors come into play, used to detect individuals and privacy mask them through blurring. The problem of undesired false positive detections, typical for pedestrian detectors and unavoidable, still leaves undesired areas of the images being blurred. We tackled this problem using application-specific scene constraints, modelled by a height-position mapping based on scene-specific pedestrian annotation data, combined with reducing the field of interest and case-specific false positive elimination classifiers. We applied a soft blurring technique to avoid the artificial look of simply applying Gaussian blurring to the found detections, which results in an effective fully-automated masking pipeline for privacy safeguarding in mobile mapping images. We prove that we can use pre-trained pedestrian detection models, but by collecting a limited amount of application-specific annotations and by exploiting scene-specific constraints, we are able to boost the detection accuracy enormously.

[1]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Sotiris Ioannidis,et al.  Face/Off: Preventing Privacy Leakage From Photos in Social Networks , 2015, CCS.

[3]  Toon Goedemé,et al.  How to Exploit Scene Constraints to Improve Object Categorization Algorithms for Industrial Applications? , 2013, VISAPP.

[4]  Paul A. Beardsley,et al.  Extending the Performance of Human Classifiers Using a Viewpoint Specific Approach , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[5]  Akihisa Kodate,et al.  Relationship between Willingness to Share Photos and Preferred Level of Photo Blurring for Privacy Protection , 2015 .

[6]  Toon Goedemé,et al.  Is the Game worth the Candle? - Evaluation of OpenCL for Object Detection Algorithm Optimization , 2012, PECCS.

[7]  Tinne Tuytelaars,et al.  A Warping Window Approach to Real-time Vision-based Pedestrian Detection in a Truck's Blind Spot Zone , 2012, ICINCO.

[8]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[10]  Noboru Babaguchi,et al.  Facial expression preserving privacy protection using image melding , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[11]  Paul E. Rybski,et al.  Real-time pedestrian detection with deformable part models , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[12]  Alexei A. Efros,et al.  Unbiased look at dataset bias , 2011, CVPR 2011.

[13]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Yonghong Tian,et al.  Robust multiple cameras pedestrian detection with multi-view Bayesian network , 2015, Pattern Recognit..