Synthetic face generation from in-the-wild face components swapping

Facial identification has recently been a legal con-cern for protecting one's identity and personal confidentiality. Many face synthesis techniques were used to safeguard individual users' data. This work presents a technique for generating synthetic faces from in-the-wild face components. The face components, such as the eyes, eyebrows, nose, and mouth, were extracted from a facial landmark of in-the-wild images and ran-domly replaced with the original image. Generative Adversarial Networks (GANs) for face restoration were then used to denoise the swapped image while preserving the original colorization. The experiments on face swapping with ten thousand of wild images demonstrate an average of 0.723 difference from the source image. The result shows that our face component swapping technique could be an effective lawful way to use facial data in the future.

[1]  Minghui Li,et al.  Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Linyuan Wang,et al.  ShapeEditor: A StyleGAN Encoder for Stable and High Fidelity Face Swapping , 2022, Frontiers in Neurorobotics.

[3]  Yutong Zhou,et al.  Generative Adversarial Network for Text-to-Face Synthesis and Manipulation , 2021, ACM Multimedia.

[4]  Thomas J. Cashman,et al.  Fake it till you make it: face analysis in the wild using synthetic data alone , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[5]  Bo Liu,et al.  IdentityDP: Differential Private Identification Protection for Face Images , 2021, Neurocomputing.

[6]  Xintao Wang,et al.  Towards Real-World Blind Face Restoration with Generative Facial Prior , 2021, Computer Vision and Pattern Recognition.

[7]  Richard van Noorden The ethical questions that haunt facial-recognition research , 2020, Nature.

[8]  Ben Y. Zhao,et al.  Fawkes: Protecting Privacy against Unauthorized Deep Learning Models , 2020, USENIX Security Symposium.

[9]  Fang Wen,et al.  FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping , 2019, ArXiv.

[10]  Guodong Guo,et al.  A survey on deep learning based face recognition , 2019, Comput. Vis. Image Underst..

[11]  Fan Zhang,et al.  MediaPipe: A Framework for Building Perception Pipelines , 2019, ArXiv.

[12]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Wanquan Liu,et al.  Expression of Concern: Facial feature discovery for ethnicity recognition , 2018, WIREs Data Mining and Knowledge Discovery.

[14]  Omkar M. Parkhi,et al.  VGGFace2: A Dataset for Recognising Faces across Pose and Age , 2017, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[15]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[16]  K. Sheikh Saving Face. , 2017, Scientific American.

[17]  J. Horvat THE ETHICS OF ARTIFICIAL INTELLIGENCE , 2016 .