Role for 2D image generated 3D face models in the rehabilitation of facial palsy

The outcome for patients diagnosed with facial palsy has been shown to be linked to rehabilitation. Dense 3D morphable models have been shown within the computer vision to create accurate representations of human faces even from single 2D images. This has the potential to provide feedback to both the patient and medical expert dealing with the rehabilitation plan. It is proposed that a framework for the creation and measuring of patient facial movement consisting of a hybrid 2D facial landmark fitting technique which shows better accuracy in testing than current methods and 3D model fitting.

[1]  Timothy J Eviston,et al.  Reply: Validation of the Clinician-Graded Electronic Facial Paralysis Assessment. , 2018, Plastic and reconstructive surgery.

[2]  Xiaoming Liu,et al.  Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Charles Hadlock,et al.  Clinician-Graded Electronic Facial Paralysis Assessment: The eFACE , 2015, Plastic and reconstructive surgery.

[4]  Simonetta Monini,et al.  Kabat rehabilitation for Bell’s palsy in the elderly , 2017, Acta oto-laryngologica.

[5]  T. Hadlock,et al.  Comprehensive Facial Rehabilitation Improves Function in People With Facial Paralysis: A 5-Year Experience at the Massachusetts Eye and Ear Infirmary , 2010, Physical Therapy.

[6]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Lisa E Ishii,et al.  Facial Nerve Rehabilitation. , 2016, Facial plastic surgery clinics of North America.

[8]  Stefanos Zafeiriou,et al.  Robust Discriminative Response Map Fitting with Constrained Local Models , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Yiying Tong,et al.  FaceWarehouse: A 3D Facial Expression Database for Visual Computing , 2014, IEEE Transactions on Visualization and Computer Graphics.

[10]  Junyu Dong,et al.  Automatic recognition of facial movement for paralyzed face. , 2014, Bio-medical materials and engineering.

[11]  S. Ayari Khalfallah,et al.  Paralysie faciale chez l'enfant , 2007 .

[12]  Deepak Ghimire,et al.  Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines , 2013, Sensors.

[13]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[14]  Xiangyu Zhu,et al.  High-fidelity Pose and Expression Normalization for face recognition in the wild , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Sami Romdhani,et al.  A 3D Face Model for Pose and Illumination Invariant Face Recognition , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[16]  Xiangyu Zhu,et al.  Face Alignment in Full Pose Range: A 3D Total Solution , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.