The Feasibility of An Automatical Facial Evaluation System Providing Objective and Reliable Results for Facial Palsy

Facial palsy would lead to a series of physical and mental problems, as facial function plays an important role in various aspects of daily life. However, the current strategies for evaluating facial function relied heavily on raters and the results varied from the experience of raters. Thus, an objective and accurate facial evaluation system is always claimed. In this study, a customized automatical facial evaluation system (AFES) was proposed, which might have the potential to be employed as an adjunctive and efficient assessing method in clinic. In order to investigate the feasibility of AFES, ninety-two participants with facial palsy were recruited and received scale-based subjective manual evaluation (including mHBGS and mSFGS) and objective automatical evaluation of AFES (including aHBGS, aSFGS and indicators of facial regional features) at enrollment and after two weeks. The correlations between the results of the two methods were analyzed and the participants were stratified according to the severity of facial function for further analyses. Strong positive correlations between manual and automatical HBGS and SFGS were observed and higher correlations were reported in the participants with normal-mild and moderate facial palsy. Significant improvements in clinical scales and indicator of eye synkinesis were found in forty-two participants in two weeks. Furthermore, some of the indicators were correlated with scale scores (I4, I7) and one of them presented a significant change between the baseline evaluation and follow-up evaluation (I7). According to the results, AFES could be considered as a viable method to perform objective and reliable evaluation for patients with facial palsy and provide clarified results for prognosis.

[1]  Gemma S. Parra-Dominguez,et al.  Automatic Facial Palsy Diagnosis as a Classification Problem Using Regional Information Extracted from a Photograph , 2022, Diagnostics.

[2]  G. S. Duran,et al.  Evaluation of an Automated Approach for Facial Midline Detection and Asymmetry Assessment: A Preliminary Study. , 2021, Orthodontics & craniofacial research.

[3]  G. Morone,et al.  Sunnybrook Facial Grading System reliability in subacute stroke patients. , 2021, European journal of physical and rehabilitation medicine.

[4]  Rytis Maskeliūnas,et al.  Few-Shot Learning with a Novel Voronoi Tessellation-Based Image Augmentation Method for Facial Palsy Detection , 2021, Electronics.

[5]  S. Pouwels,et al.  e-Health and telemedicine implementation in facial paralysis: challenges and pitfalls , 2021, European Journal of Plastic Surgery.

[6]  Abdullah,et al.  Mutational Dynamics of Aroid Chloroplast Genomes II , 2021, Frontiers in Genetics.

[7]  Gustavo K. Rohde,et al.  Video-Based Facial Weakness Analysis , 2021, IEEE Transactions on Biomedical Engineering.

[8]  Xin Liu,et al.  Region Based Parallel Hierarchy Convolutional Neural Network for Automatic Facial Nerve Paralysis Evaluation , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Zhen Lei,et al.  Towards Fast, Accurate and Stable 3D Dense Face Alignment , 2020, ECCV.

[10]  Zhiqiang Gao,et al.  Prognostic value of a three-dimensional dynamic quantitative analysis system to measure facial motion in acute facial paralysis patients , 2020, Head & Face Medicine.

[11]  A. Mian,et al.  Three-dimensional assessment of facial asymmetry using dense correspondence, symmetry, and midline analysis. , 2020, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[12]  J Taeger,et al.  Utilization of Smartphone Depth Mapping Cameras for App-Based Grading of Facial Movement Disorders: Development and Feasibility Study , 2020, JMIR mHealth and uHealth.

[13]  Ling Wang,et al.  Automatic Facial Paralysis Assessment via Computational Image Analysis , 2020, Journal of healthcare engineering.

[14]  P. Dijkstra,et al.  Three-Dimensional Stereophotogrammetry Assessment of Facial Asymmetry in Facial Palsy. , 2020, The Journal of craniofacial surgery.

[15]  Jun Wang,et al.  Using Eye Aspect Ratio to Enhance Fast and Objective Assessment of Facial Paralysis , 2020, Comput. Math. Methods Medicine.

[16]  Hui Yu,et al.  A Review on Automated Facial Nerve Function Assessment From Visual Face Capture , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Martinus M. van Veen,et al.  Toward an Automatic System for Computer-Aided Assessment in Facial Palsy , 2019, Facial plastic surgery & aesthetic medicine.

[18]  T. Hadlock,et al.  Clinician and Automated Assessments of Facial Function Following Eyelid Weight Placement. , 2019, JAMA facial plastic surgery.

[19]  O. Witte,et al.  Automated objective and marker-free facial grading using photographs of patients with facial palsy , 2019, European Archives of Oto-Rhino-Laryngology.

[20]  Ting Wang,et al.  Automatic Facial Paralysis Evaluation Augmented by a Cascaded Encoder Network Structure , 2019, IEEE Access.

[21]  T. C. Chang,et al.  Evaluation of a computer-based facial dysmorphology analysis algorithm (Face2Gene) using standardized textbook photos , 2019, Eye.

[22]  Aleix M. Martinez,et al.  Emotional Expressions Reconsidered: Challenges to Inferring Emotion From Human Facial Movements , 2019, Psychological science in the public interest : a journal of the American Psychological Society.

[23]  Stav Brown,et al.  Facial Nerve Trauma: Clinical Evaluation and Management Strategies , 2019, Plastic and reconstructive surgery.

[24]  Franco Marinozzi,et al.  Validation of the objective assessment of facial movement with a new software-based system , 2019, Acta oto-laryngologica.

[25]  K. Park,et al.  Comparison between Subjective Scoring and Computer-Based Asymmetry Assessment in Facial Nerve Palsy , 2018, Journal of audiology & otology.

[26]  Joseph R Dusseldorp,et al.  Outcome Tracking in Facial Palsy. , 2018, Otolaryngologic clinics of North America.

[27]  Mara W Robinson,et al.  Facial Rehabilitation: Evaluation and Treatment Strategies for the Patient with Facial Palsy. , 2018, Otolaryngologic clinics of North America.

[28]  D. Lundqvist,et al.  Human Observers and Automated Assessment of Dynamic Emotional Facial Expressions: KDEF-dyn Database Validation , 2018, Front. Psychol..

[29]  Lei Yao,et al.  Effects of tirofiban on stent thrombosis, Hs-CRP, IL-6 and sICAM-1 after PCI of acute myocardial infarction , 2018, Experimental and therapeutic medicine.

[30]  T. Hadlock,et al.  A Machine Learning Approach for Automated Facial Measurements in Facial Palsy. , 2018, JAMA facial plastic surgery.

[31]  Gee-Sern Jison Hsu,et al.  Hierarchical Network for Facial Palsy Detection , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Xi Zhou,et al.  Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network , 2018, ECCV.

[33]  Song Anping,et al.  Assessment for facial nerve paralysis based on facial asymmetry , 2017, Australasian Physical & Engineering Sciences in Medicine.

[34]  Stephanie M Carpenter,et al.  Importance of Reporting Duration of Facial Paralysis in Studies of Emotion and Well-being. , 2017, JAMA facial plastic surgery.

[35]  Georgios Tzimiropoulos,et al.  How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230,000 3D Facial Landmarks) , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Yen-Wei Chen,et al.  Quantitative analysis of facial paralysis based on three-dimensional features , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[37]  Ricardo Horta,et al.  Facegram - Objective quantitative analysis in facial reconstructive surgery , 2016, J. Biomed. Informatics.

[38]  Xu-long Liu,et al.  [Automatic Assessment of Facial Nerve Function Based on Infrared Thermal Imaging]. , 2016, Guang pu xue yu guang pu fen xi = Guang pu.

[39]  Manal Abdel Wahed,et al.  Quantifying facial paralysis using the kinect v2 , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[40]  Young Ho Kim,et al.  A Smartphone-Based Automatic Diagnosis System for Facial Nerve Palsy , 2015, Sensors.

[41]  Xulong Liu,et al.  Quantitative assessment of facial paralysis using infrared thermal imaging , 2015, 2015 8th International Conference on Biomedical Engineering and Informatics (BMEI).

[42]  Joachim Denzler,et al.  Automated and objective action coding of facial expressions in patients with acute facial palsy , 2015, European Archives of Oto-Rhino-Laryngology.

[43]  T. Hadlock,et al.  Facial Nerve Grading Instruments: Systematic Review of the Literature and Suggestion for Uniformity , 2015, Plastic and reconstructive surgery.

[44]  C. Beurskens,et al.  Quality of life assessment in facial palsy: validation of the Dutch Facial Clinimetric Evaluation Scale , 2015, European Archives of Oto-Rhino-Laryngology.

[45]  T. Hadlock,et al.  Survey of methods of facial palsy documentation in use by members of the Sir Charles Bell Society , 2014, The Laryngoscope.

[46]  Stefanos Zafeiriou,et al.  300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[47]  T. Hadlock,et al.  A Comparison of Facial Nerve Grading Systems , 2012, Annals of plastic surgery.

[48]  A. Klassen,et al.  Measuring Quality of Life and Patient Satisfaction in Facial Paralysis Patients: A Systematic Review of Patient-Reported Outcome Measures , 2012, Plastic and reconstructive surgery.

[49]  T. Hadlock,et al.  Toward a universal, automated facial measurement tool in facial reanimation. , 2012, Archives of facial plastic surgery.

[50]  J. Neely,et al.  Sunnybrook facial grading system: Reliability and criteria for grading , 2010, The Laryngoscope.

[51]  Orlando Guntinas-Lichius,et al.  Facial muscle activation patterns in healthy male humans: A multi-channel surface EMG study , 2010, Journal of Neuroscience Methods.

[52]  John J. Soraghan,et al.  Quantitative Analysis of Facial Paralysis Using Local Binary Patterns in Biomedical Videos , 2009, IEEE Transactions on Biomedical Engineering.

[53]  Cristina Montomoli,et al.  Usefulness of BFB/EMG in facial palsy rehabilitation , 2005, Disability and rehabilitation.

[54]  N. O'dwyer,et al.  Expression of Emotion and Quality of Life After Facial Nerve Paralysis , 2004, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[55]  M. Ikeda,et al.  [An assessment of psychological stress in patients with facial palsy]. , 2003, Nihon Jibiinkoka Gakkai kaiho.

[56]  J Kanzaki,et al.  A comparison and conversion table of 'the House-Brackmann facial nerve grading system' and 'the Yanagihara grading system'. , 2000, Auris, nasus, larynx.

[57]  J. Nedzelski,et al.  Development of a sensitive clinical facial grading system. , 1996, European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery.

[58]  J. W. House,et al.  Facial Nerve Grading System , 1985, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[59]  C. Nduka,et al.  AFLFP: A Database With Annotated Facial Landmarks for Facial Palsy , 2023, IEEE Transactions on Computational Social Systems.

[60]  Gee-Sern Jison Hsu,et al.  Deep Hierarchical Network With Line Segment Learning for Quantitative Analysis of Facial Palsy , 2019, IEEE Access.

[61]  Yonatan Glassner,et al.  Mobile Application for Diagnosis of Facial Palsy , 2014 .

[62]  C. Aubá,et al.  Automatic three-dimensional quantitative analysis for evaluation of facial movement. , 2008, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[63]  F. C. Macgregor,et al.  Facial disfigurement: Problems and management of social interaction and implications for mental health , 2005, Aesthetic Plastic Surgery.