Analyzing of facial paralysis by shape analysis of 3D face sequences

In this paper, we address the problem of quantifying the facial asymmetry from 3D face sequence (4D). We investigate the role of 4D data to reveal the amount of both static and dynamic asymmetry in the clinical case of facial paralysis. The goal is to provide tools to clinicians to evaluate quantitatively facial paralysis treatment based on Botulinum Toxin (BT), which can provide qualitative and quantitative evaluations. To this end, Dense Scalar Fields (DSFs), based on Riemannian analysis of 3D facial shape, is proposed to quantify facial deformations. To assess this approach, a new 3D facial sequences of 16 patients data set is collected, before and after injecting the BT. For each patient, we have collected 8 facial expressions before and after injecting BT. Experimental results obtained on this data set show that the proposed approach allows clinicians to evaluate more accurately the facial asymmetry before and after the treatment.

[1]  Ioannis A. Kakadiaris,et al.  3D/4D facial expression analysis: An advanced annotated face model approach , 2012, Image Vis. Comput..

[2]  Anuj Srivastava,et al.  Shape Analysis of Elastic Curves in Euclidean Spaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Mohamed Daoudi,et al.  Facial Asymmetry Assessment from 3D Shape Sequences: The Clinical Case of Facial Paralysis , 2016, VISIGRAPP.

[4]  Anuj Srivastava,et al.  A Novel Representation for Riemannian Analysis of Elastic Curves in Rn , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Stefanos Zafeiriou,et al.  Recognition of 3D facial expression dynamics , 2012, Image Vis. Comput..

[6]  Stefanos Zafeiriou,et al.  Active nonrigid ICP algorithm , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[7]  Emmanuel Dellandréa,et al.  A unified probabilistic framework for automatic 3D facial expression analysis based on a Bayesian belief inference and statistical feature models , 2013, Image Vis. Comput..

[8]  Bogdan J. Matuszewski,et al.  Facial asymmetry analysis based on 3-D dynamic scans , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[9]  Ioannis A. Kakadiaris,et al.  Automatic 2.5-D Facial Landmarking and Emotion Annotation for Social Interaction Assistance , 2016, IEEE Transactions on Cybernetics.

[10]  Manal Abdel Wahed,et al.  Quantifying facial paralysis using the kinect v2 , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  R. P. Clark,et al.  Botulinum toxin: a treatment for facial asymmetry caused by facial nerve paralysis. , 2005, Plastic and reconstructive surgery.

[12]  Liming Chen,et al.  3D facial expression recognition via multiple kernel learning of Multi-Scale Local Normal Patterns , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[13]  Liming Chen,et al.  Automatic 3D facial expression recognition using geometric scattering representation , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[14]  R. Filipo,et al.  Botulinum toxin in the treatment of facial synkinesis and hyperkinesis , 2012, The Laryngoscope.

[15]  Hassen Drira,et al.  4-D Facial Expression Recognition by Learning Geometric Deformations , 2014, IEEE Transactions on Cybernetics.

[16]  M. Risoud,et al.  Long-term sequelae treatment of peripheral facial paralysis with botulinum toxin type A: Repartition and kinetics of doses used. , 2016, Annales de chirurgie plastique et esthetique.

[17]  A. Ayoub,et al.  A new method for automatic tracking of facial landmarks in 3D motion captured images (4D). , 2013, International journal of oral and maxillofacial surgery.

[18]  A. Ayoub,et al.  The clinical application of three-dimensional motion capture (4D): a novel approach to quantify the dynamics of facial animations. , 2013, International journal of oral and maxillofacial surgery.

[19]  P. Guerreschi,et al.  Séquelles de paralysie faciale et toxine botulique , 2015 .

[20]  Ioannis A. Kakadiaris,et al.  Accurate Landmarking of Three-Dimensional Facial Data in the Presence of Facial Expressions and Occlusions Using a Three-Dimensional Statistical Facial Feature Model , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Liming Chen,et al.  Muscular Movement Model-Based Automatic 3D/4D Facial Expression Recognition , 2015, IEEE Transactions on Multimedia.