Deep Learning based Human Detection in Privacy-Preserved Surveillance Videos

Visual surveillance systems have been improving rapidly over the recent past, becoming more capable and pervasive with incorporation of artificial intelligence. At the same time such surveillance systems are exposing the public to new privacy and security threats. There have been an increasing number of reports of blatant abuse of surveillance technologies. To counteract this, data privacy regulations (e.g. GDPR in Europe) have provided guidelines for data collection and data processing. However, there is still a need for a private and secure method of model training for advanced machine learning and deep learning algorithms. To this end, in this paper we propose a privacy-preserved method for visual surveillance. We first develop a dataset of privacy preserved videos. The data in these videos is masked using Gaussian Mixture Model (GMM) and selective encryption. We then train high-performance object detection models on the generated dataset. The proposed method utilizes state-of-art object detection deep learning models (viz. YOLOv4 and YOLOv5) to perform human/object detection in masked videos. The results are encouraging, and are pointers to the viability of the use of modern day deep learning models for object detection in privacy-preserved videos.

[1]  Nadia Kanwal,et al.  A Survey of Modern Deep Learning based Object Detection Models , 2021, Digit. Signal Process..

[2]  Sencun Zhu,et al.  PriSE: Slenderized Privacy-Preserving Surveillance as an Edge Service , 2020, 2020 IEEE 6th International Conference on Collaboration and Internet Computing (CIC).

[3]  Alem Fitwi,et al.  Privacy-Preserving Selective Video Surveillance , 2020, 2020 29th International Conference on Computer Communications and Networks (ICCCN).

[4]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[5]  Martin Fleury,et al.  Visual Surveillance Within the EU General Data Protection Regulation: A Technology Perspective , 2019, IEEE Access.

[6]  Babak Majidi,et al.  Deep Visual Privacy Preserving for Internet of Robotic Things , 2019, 2019 5th Conference on Knowledge Based Engineering and Innovation (KBEI).

[7]  2019 5th Conference on Knowledge Based Engineering and Innovation (KBEI) , 2019 .

[8]  Michael S. Ryoo,et al.  Privacy-Preserving Human Activity Recognition from Extreme Low Resolution , 2016, AAAI.

[9]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Alexandros Iosifidis,et al.  Person de-identification in activity videos , 2014, 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[11]  Neil M. Richards The Dangers of Surveillance , 2013 .

[12]  Kosmas Dimitropoulos,et al.  Video sensor network for real-time traffic monitoring and surveillance , 2010 .

[13]  N. Kanwal,et al.  Towards a privacy preserving surveillance approach for smart cities , 2021, 3rd Smart Cities Symposium (SCS 2020).

[14]  Xiaoqian Jiang,et al.  HEAR: Human Action Recognition via Neural Networks on Homomorphically Encrypted Data , 2021, ArXiv.

[15]  Sam Kwong,et al.  Privacy-Preserving In-Home Fall Detection Using Visual Shielding Sensing and Private Information-Embedding , 2021, IEEE Transactions on Multimedia.

[16]  Edward Curry,et al.  A Survey on Object Detection for the Internet of Multimedia Things (IoMT) using Deep Learning and Event-based Middleware: Approaches, Challenges, and Future Directions , 2021, Image Vis. Comput..

[17]  Improving Patient Safety Through Video Monitoring. , 2018, Rehabilitation nursing : the official journal of the Association of Rehabilitation Nurses.

[18]  Hrvoje Gebavi,et al.  and Communication Technology, Electronics and Microelectronics (MIPRO) , 2015 .

[19]  R. Buyya,et al.  Object Oriented Programming with Java : Essentials and Applications , 2009 .