Multi-scale Landmark Localization Network for 3D Facial Point Clouds

∗Facial landmark localization on 3D point clouds has been a major concern in the field of computer vision. Recent methods do not feature data containing multiple faces with large-scale variance, which has become increasingly common with the rapid development and wide application of 3D imaging technology. In this paper, we propose a Multi-scale Landmark Localization network for 3D facial point clouds. We evaluate the proposed method on the dataset synthesized by appending and scaling the data in the public dataset BU3DFE to demonstrate the robustness and efficiency. Upon comparing the proposed method with other methods on the standard dataset BU3DFE, in which data only contain one face with smallscale variance, we find that the proposed method shows higher or comparable performance with mean localization errors of 3.34 ± 2.19 mm.

[1]  Syed Zulqarnain Gilani,et al.  Dense 3D Face Correspondence , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Fuxin Li,et al.  PointConv: Deep Convolutional Networks on 3D Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Jim Austin,et al.  A Machine-Learning Approach to Keypoint Detection and Landmarking on 3D Meshes , 2012, International Journal of Computer Vision.

[4]  Wajdi Farhat,et al.  Novel Technique for 3D Face Recognition Using Anthropometric Methodology , 2018, Int. J. Ambient Comput. Intell..

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[7]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Rasmus R. Paulsen,et al.  Multi-view Consensus CNN for 3D Facial Landmark Placement , 2018, ACCV.

[9]  Xin Fan,et al.  3D facial landmark localization using texture regression via conformal mapping , 2016, Pattern Recognit. Lett..

[10]  Andrea Cavallaro,et al.  3-D Face Detection, Landmark Localization, and Registration Using a Point Distribution Model , 2009, IEEE Transactions on Multimedia.

[11]  Shiming Xiang,et al.  Relation-Shape Convolutional Neural Network for Point Cloud Analysis , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[13]  Stefano Tornincasa,et al.  Cleft lip pathology diagnosis and foetal landmark extraction via 3D geometrical analysis , 2017 .

[14]  C. Qi.  Deep Learning on Point Sets for 3 D Classification and Segmentation , 2016 .

[15]  Ajmal S. Mian,et al.  Shape-based automatic detection of a large number of 3D facial landmarks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Yehoshua Y. Zeevi,et al.  The farthest point strategy for progressive image sampling , 1997, IEEE Trans. Image Process..

[17]  Paul F. Whelan,et al.  3-D Facial Landmark Localization With Asymmetry Patterns and Shape Regression from Incomplete Local Features , 2015, IEEE Transactions on Cybernetics.

[18]  Paul F. Whelan,et al.  Rotationally Invariant 3D Shape Contexts using Asymmetry Patterns , 2016, GRAPP/IVAPP.

[19]  NairPrathap,et al.  3-D face detection, landmark localization, and registration using a point distribution model , 2009 .

[20]  A F Ayoub,et al.  Towards building a photo-realistic virtual human face for craniomaxillofacial diagnosis and treatment planning. , 2007, International journal of oral and maxillofacial surgery.

[21]  Federico Sukno,et al.  Local Shape Spectrum Analysis for 3D Facial Expression Recognition , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[22]  LuoZhongxuan,et al.  3D facial landmark localization using texture regression via conformal mapping , 2016 .

[23]  Stefan Zachow,et al.  Fully Automated and Highly Accurate Dense Correspondence for Facial Surfaces , 2016, ECCV Workshops.

[24]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[25]  Nicu Sebe,et al.  The First 3D Face Alignment in the Wild (3DFAW) Challenge , 2016, ECCV Workshops.

[26]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .