An Online Tool for the Annotation of 3D Models

Annotation of data is fundamental for training any modern facial tracking system. Methods, such as deep and machine learning, require large amounts of pre-annotated data to produce results found in many state-of-the-art systems. 2- Dimensional (images) annotations rely on the texture information of the face to annotate the features. However, in 3-Dimensions (models), the task becomes more complex. In 3D, the conventional 2D approaches are ineffective as facial landmarks are difficult to accurately identify without texture information. There has been little research into the accuracy of methods for annotating 3D facial models. This paper proposes a method for annotating 3D models which uses texture information by aligning a model to a 2D image to compare its accuracy and throughput to the conventional methods of 3D annotation. For evaluation, 16 nonexpert volunteers were recruited and instructed to annotate three models using both the proposed method and the conventional method. The resultant annotations were compared to ground truth data generated by an experienced annotator. The results demonstrate significant improvement in the throughput of the proposed annotation method compared to the conventional approach without significant differences in accuracy. The proposed method also highlights that the conventional method does not successfully identify all the facial landmarks. The proposed method will be made freely available to use online.

[1]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[2]  Markus Eberl Maya , 2019, The Americas.

[3]  Ioannis A. Kakadiaris,et al.  Viewpoint invariant 3D landmark model inference from monocular 2D images using higher-order priors , 2011, 2011 International Conference on Computer Vision.

[4]  艾而帝,et al.  Microsoft Kinect 虛擬復健系統設計 , 2013 .

[5]  Luc Van Gool,et al.  Face Detection without Bells and Whistles , 2014, ECCV.

[6]  Nicholas Costen,et al.  SAMM: A Spontaneous Micro-Facial Movement Dataset , 2018, IEEE Transactions on Affective Computing.

[7]  Ajmal S. Mian,et al.  Shape-based automatic detection of a large number of 3D facial landmarks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Paolo Cignoni,et al.  Minimizing user intervention in registering 2D images to 3D models , 2005, The Visual Computer.

[9]  Hassan Ugail,et al.  Facial Behavioral Analysis: A Case Study in Deception Detection , 2014 .

[10]  Adrian Hilton,et al.  A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling , 2011, 2011 International Conference on Computer Vision.

[11]  Timothy F. Cootes,et al.  Boosted Regression Active Shape Models , 2007, BMVC.

[12]  Baihua Li,et al.  Will Wrinkle Estimate the Face Age? , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.