Intended human object detection for automatically protecting privacy in mobile video surveillance

With the recent popularization of mobile video cameras including camera phones, a new technology, mobile video surveillance, which uses mobile video cameras for video surveillance has been emerging. Such videos, however, may infringe upon the privacy of others by disclosing privacy sensitive information (PSI), i.e., their appearances. To prevent videos from infringing on the right to privacy, new techniques are required that automatically obscure PSI regions. The problem is how to determine the PSI regions to be obscured while maintaining enough video content to present the camera persons’ capture-intentions, i.e., what they want to record in their videos to achieve their surveillance tasks. To this end, we introduce a new concept called intended human objects that are defined as human objects essential for capture-intentions, and develop a new method called intended human object detection that automatically detects the intended human objects in videos taken by different camera persons. Through the process of intended human object detection, we develop a system for automatically obscuring PSI regions. We experimentally show the performance of intended human object detection and the contributions of the features used. Our user study shows the potential applicability of our proposed system.

[1]  Jonas Landgren,et al.  Mobile live video in emergency response: Its use and consequences , 2010 .

[2]  Jianping Fan,et al.  Detecting intended human objects in human-captured videos , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[3]  Frédéric Dufaux,et al.  Efficient, robust, and fast global motion estimation for video coding , 2000, IEEE Trans. Image Process..

[4]  Tao Mei,et al.  Modeling and Mining of Users' Capture Intention for Home Videos , 2007, IEEE Transactions on Multimedia.

[5]  Jack Brassil,et al.  Technical Challenges in Location-Aware Video Surveillance Privacy , 2009, Protecting Privacy in Video Surveillance.

[6]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[7]  Harry Shum,et al.  Full-frame video stabilization with motion inpainting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  P. Bartlett,et al.  Probabilities for SV Machines , 2000 .

[9]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[10]  Lie Lu,et al.  A generic framework of user attention model and its application in video summarization , 2005, IEEE Trans. Multim..

[11]  Ralph Gross,et al.  Semi-supervised learning of multi-factor models for face de-identification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Jianping Fan,et al.  Constructing Distributed Hippocratic Video Databases for Privacy-Preserving Online Patient Training and Counseling , 2009, IEEE Transactions on Information Technology in Biomedicine.

[13]  Lie Lu,et al.  Optimization-based automated home video editing system , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  M. Vijay Venkatesh,et al.  Privacy Protection for Life-log Video , 2007 .

[15]  Jonas Landgren,et al.  Using live video for information sharing in emergency response work , 2009 .

[16]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[17]  Marco Zennaro,et al.  Large-scale privacy protection in Google Street View , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Lie Lu,et al.  AVE: automated home video editing , 2003, ACM Multimedia.

[19]  Jianping Fan,et al.  A novel approach for privacy-preserving video sharing , 2005, CIKM '05.

[20]  Jonas Landgren,et al.  Information Sharing Using Live Video , 2009 .

[21]  Rong Yan,et al.  Tools for Protecting the Privacy of Specific Individuals in Video , 2007, EURASIP J. Adv. Signal Process..

[22]  Carman Neustaedter,et al.  Blur filtration fails to preserve privacy for home-based video conferencing , 2006, TCHI.

[23]  Rita Cucchiara,et al.  Mobile Video Surveillance Systems: An Architectural Overview , 2008, WMMP.

[24]  Touradj Ebrahimi,et al.  Scrambling for Privacy Protection in Video Surveillance Systems , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Shin-ichi Hanaki,et al.  Privacy protection by concealing persons in circumstantial video image , 2001, PUI '01.

[26]  Laurent Itti,et al.  Interesting objects are visually salient. , 2008, Journal of vision.

[27]  Tao Mei,et al.  Video Collage: A Novel Presentation of Video Sequence , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[28]  Bilge Yesil,et al.  Recording and Reporting: Camera Phones, User-Generated Images and Surveillance , 2011 .

[29]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Serge J. Belongie,et al.  Removing pedestrians from Google street view images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[31]  Christopher Edwards,et al.  The effects of filtered video on awareness and privacy , 2000, CSCW '00.

[32]  Noboru Babaguchi,et al.  Psychological Study for Designing Privacy Protected Video Surveillance System: PriSurv , 2009, Protecting Privacy in Video Surveillance.

[33]  Pierre Baldi,et al.  A principled approach to detecting surprising events in video , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Liang-Tien Chia,et al.  Attention-from-motion: A factorization approach for detecting attention objects in motion , 2009, Comput. Vis. Image Underst..

[35]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Norihiro Hagita,et al.  Stealth vision for protecting privacy , 2004, ICPR 2004.

[37]  Hiroshi Murase,et al.  Fast visual search using focused color matching - active search , 2000, Systems and Computers in Japan.

[38]  S. Metlapally,et al.  The effect of positive lens defocus on ocular growth and emmetropization in the tree shrew. , 2008, Journal of vision.

[39]  Mohan M. Trivedi,et al.  A track-based human movement analysis and privacy protection system adaptive to environmental contexts , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[40]  Jianping Fan,et al.  Automatically protecting privacy in consumer generated videos using intended human object detector , 2010, ACM Multimedia.

[41]  Noboru Babaguchi,et al.  Privacy protecting visual processing for secure video surveillance , 2008, 2008 15th IEEE International Conference on Image Processing.