SIAT-3DFE: A High-Resolution 3D Facial Expression Dataset

3D facial expression dataset plays an essential role in computer vision and computer graphics, especially to the data-driven machine learning algorithms like deep-learning etc. In contrast with traditional low-resolution and low-accuracy 3D face related datasets, an accurate and dense facial expression database was introduced in this paper. During the period from January to June 2019, we have collected 8,000 3D facial expression models and 32,000 texture images from 500 subjects. The 3D facial capture device works based on structured light principle. The procedure of 3D face capture and property of 3D samples are introduced in details. The proposed high-accuracy 3D face dataset can be used in many 3D applications, like recognition, animation, and 3D facial expression simulations.

[1]  Bernhard Egger,et al.  Occlusion-aware 3D Morphable Face Models , 2016, BMVC.

[2]  Wan-Chun Ma,et al.  The Digital Emily Project: Achieving a Photorealistic Digital Actor , 2010, IEEE Computer Graphics and Applications.

[3]  Raimondo Schettini,et al.  UMB-DB: A database of partially occluded 3D faces , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[4]  Juyong Zhang,et al.  Disentangled Representation Learning for 3D Face Shape , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Stefanos Zafeiriou,et al.  Large Scale 3D Morphable Models , 2017, International Journal of Computer Vision.

[6]  Dacheng Tao,et al.  Robust Face Recognition via Multimodal Deep Face Representation , 2015, IEEE Transactions on Multimedia.

[7]  Stefanos Zafeiriou,et al.  A survey on face detection in the wild: Past, present and future , 2015, Comput. Vis. Image Underst..

[8]  Jihun Yu,et al.  Unconstrained realtime facial performance capture , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[10]  Alan C. Bovik,et al.  Texas 3D Face Recognition Database , 2010, 2010 IEEE Southwest Symposium on Image Analysis & Interpretation (SSIAI).

[11]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[12]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[13]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[14]  David Declercq,et al.  3D face recognition using covariance based descriptors , 2016, Pattern Recognit. Lett..

[15]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[16]  Patrick Pérez,et al.  State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications , 2018, Comput. Graph. Forum.

[17]  Mei Wang,et al.  Deep Face Recognition: A Survey , 2018, Neurocomputing.

[18]  Yiying Tong,et al.  FaceWarehouse: A 3D Facial Expression Database for Visual Computing , 2014, IEEE Transactions on Visualization and Computer Graphics.

[19]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[20]  Jie Liao,et al.  Texture Mapping for 3D Reconstruction with RGB-D Sensor , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Sergio Escalera,et al.  Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Taghi M. Khoshgoftaar,et al.  A Survey of 2D Face Databases , 2015, 2015 IEEE International Conference on Information Reuse and Integration.

[23]  Melih S. Aslan,et al.  Large-scale Datasets: Faces with Partial Occlusions and Pose Variations in the Wild , 2017, ArXiv.

[24]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[25]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Omid Ekrami,et al.  MeshMonk: Open-source large-scale intensive 3D phenotyping , 2019, Scientific Reports.

[27]  Xiangyu Zhu,et al.  Face Alignment in Full Pose Range: A 3D Total Solution , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Thabo Beeler,et al.  Real-time high-fidelity facial performance capture , 2015, ACM Trans. Graph..

[29]  Andrew Jones,et al.  Mesoscopic Facial Geometry Inference Using Deep Neural Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Ronald Chung,et al.  An Accurate and Robust Strip-Edge-Based Structured Light Means for Shiny Surface Micromeasurement in 3-D , 2013, IEEE Transactions on Industrial Electronics.

[31]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..