Anonymization of Human Gait in Video Based on Silhouette Deformation and Texture Transfer

These days, a lot of videos are uploaded onto web-based video sharing services such as YouTube. These videos can be freely accessed from all over the world. On the other hand, they often contain the appearance of walking private people, which could be identified by silhouette-based gait recognition techniques rapidly developed in recent years. This causes a serious privacy issue. To avoid it, this paper proposes a method for anonymizing the appearance of walking people, namely human gait, in video. In the proposed method, we first crop human regions from all frames in an input video and binarize them to get their silhouettes. Next, we slightly deform the silhouettes from the aspects of static body shape and dynamic walking rhythm so that the person in the input video cannot be correctly identified by gait recognition techniques. After that, the textures of the original human regions are transferred onto the deformed silhouettes. We achieve this by a displacement field-based approach, which is training-free and thus robust to a variety of clothes. Finally, the anonymized human regions with the transferred textures are filled back into the input video. In the results of our experiments, we successfully degraded the accuracy of CNN-based gait recognition systems from 100% to 1.57% in the lowest case without yielding serious distortion in the appearance of the human regions, which demonstrated the effectiveness of the proposed method.

[1]  I. Mehmood,et al.  A Meta-Heuristic Optimization Based Less Imperceptible Adversarial Attack on Gait Based Surveillance Systems , 2022, Journal of Signal Processing Systems.

[2]  Jie Zhou,et al.  Gait Recognition in the Wild: A Benchmark , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[3]  Annan Li,et al.  Cross-View Gait Recognition with Deep Universal Linear Embeddings , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  T. Tan,et al.  Temporal sparse adversarial attack on sequence-based gait recognition , 2020, Pattern Recognit..

[5]  Junichi Yamagishi,et al.  An RGB Gait Anonymization Model for Low-Quality Silhouettes , 2019, 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[6]  Naoko Nitta,et al.  Anonymization of Gait Silhouette Video by Perturbing Its Phase and Shape Components , 2019, 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[7]  Frank Lindseth,et al.  DeepPrivacy: A Generative Adversarial Network for Face Anonymization , 2019, ISVC.

[8]  Junichi Yamagishi,et al.  Spatio-temporal generative adversarial network for gait anonymization , 2019, J. Inf. Secur. Appl..

[9]  Yong Jae Lee,et al.  Learning to Anonymize Faces for Privacy Preserving Action Detection , 2018, ECCV.

[10]  Luc Van Gool,et al.  Disentangled Person Image Generation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Junichi Yamagishi,et al.  An approach for gait anonymization using deep learning , 2017, 2017 IEEE Workshop on Information Forensics and Security (WIFS).

[12]  Yutaka Satoh,et al.  Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet? , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Ivan Sikiric,et al.  I Know That Person: Generative Full Body and Face De-identification of People in Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Xiaogang Wang,et al.  A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Yasushi Makihara,et al.  GEINet: View-invariant gait recognition using a convolutional neural network , 2016, 2016 International Conference on Biometrics (ICB).

[16]  Jean-Luc Dugelay,et al.  Automatic Face Anonymization in Visual Data: Are we really well protected? , 2016, Image Processing: Algorithms and Systems.

[17]  Noboru Babaguchi,et al.  Facial expression preserving privacy protection using image melding , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[18]  Aaron C. Courville,et al.  Generative Adversarial Networks , 2014, 1406.2661.

[19]  Wei Zeng,et al.  Model-Based Human Gait Recognition Via Deterministic Learning , 2014, Cognitive Computation.

[20]  Yasushi Makihara,et al.  Gait Verification System for Supporting Criminal Investigation , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[21]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Treadmill Dataset , 2012, IPSJ Trans. Comput. Vis. Appl..

[22]  Masayuki Mukunoki,et al.  Privacy-Protected Camera for the Sensing Web , 2010, IPMU.

[23]  P. J. Narayanan,et al.  Person De-Identification in Videos , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Shree K. Nayar,et al.  Face swapping: automatically replacing faces in photographs , 2008, ACM Trans. Graph..

[25]  Yasushi Makihara,et al.  Gait Recognition Using a View Transformation Model in the Frequency Domain , 2006, ECCV.

[26]  Carman Neustaedter,et al.  Blur filtration fails to preserve privacy for home-based video conferencing , 2006, TCHI.

[27]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[29]  L. Sweeney,et al.  k-Anonymity: A Model for Protecting Privacy , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[30]  Ark,et al.  Gait Recognition : Databases , Representations , and Applications , 2015 .