Machine-Learning-Based Detecting of Eyelid Closure and Smiling Using Surface Electromyography of Auricular Muscles in Patients with Postparalytic Facial Synkinesis: A Feasibility Study

Surface electromyography (EMG) allows reliable detection of muscle activity in all nine intrinsic and extrinsic ear muscles during facial muscle movements. The ear muscles are affected by synkinetic EMG activity in patients with postparalytic facial synkinesis (PFS). The aim of the present work was to establish a machine-learning-based algorithm to detect eyelid closure and smiling in patients with PFS by recording sEMG using surface electromyography of the auricular muscles. Sixteen patients (10 female, 6 male) with PFS were included. EMG acquisition of the anterior auricular muscle, superior auricular muscle, posterior auricular muscle, tragicus muscle, orbicularis oculi muscle, and orbicularis oris muscle was performed on both sides of the face during standardized eye closure and smiling tasks. Machine-learning EMG classification with a support vector machine allowed for the reliable detection of eye closure or smiling from the ear muscle recordings with clear distinction to other mimic expressions. These results show that the EMG of the auricular muscles in patients with PFS may contain enough information to detect facial expressions to trigger a future implant in a closed-loop system for electrostimulation to improve insufficient eye closure and smiling in patients with PFS.

[1]  C. Anders,et al.  Electromyography of Extrinsic and Intrinsic Ear Muscles in Healthy Probands and Patients with Unilateral Postparalytic Facial Synkinesis , 2022, Diagnostics.

[2]  Lutz Leistritz,et al.  Classification of facial movements in chronic facial palsy based on intramuscular EMG signals recorded from the paretic side , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[3]  Jonathan R. Clark,et al.  Recreation of eyelid mechanics using the sling concept✰. , 2020, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[4]  Olivier Gibaru,et al.  EMG-based online classification of gestures with recurrent neural networks , 2019, Pattern Recognit. Lett..

[5]  Joachim Denzler,et al.  Reliability of grading of facial palsy using a video tutorial with synchronous video recording , 2018, The Laryngoscope.

[6]  Y. Cakmak,et al.  Neuroprosthetics for Auricular Muscles: Neural Networks and Clinical Aspects , 2018, Front. Neurol..

[7]  Guadalupe A. Torres,et al.  Finger movements classification from grasping spherical objects with surface electromyography using time domain based features , 2016, 2016 IEEE Conference on Mechatronics, Adaptive and Intelligent Systems (MAIS).

[8]  Antti Vehkaoja,et al.  A survey on the feasibility of surface EMG in facial pacing , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  M Reischl,et al.  Steer by ear: Myoelectric auricular control of powered wheelchairs for individuals with spinal cord injury. , 2015, Restorative neurology and neuroscience.

[10]  Max Ortiz-Catalan,et al.  Cardinality as a highly descriptive feature in myoelectric pattern recognition for decoding motor volition , 2015, Front. Neurosci..

[11]  James T. Heaton,et al.  Electrical Stimulation of Eye Blink in Individuals with Acute Facial Palsy: Progress toward a Bionic Blink , 2015, Plastic and reconstructive surgery.

[12]  Alessandra Pedrocchi,et al.  Surface electromyographic mapping of the orbicularis oculi muscle for real-time blink detection. , 2014, JAMA facial plastic surgery.

[13]  James T Heaton,et al.  Infrared-based blink-detecting glasses for facial pacing: toward a bionic blink. , 2014, JAMA facial plastic surgery.

[14]  Michael Eickenberg,et al.  Machine learning for neuroimaging with scikit-learn , 2014, Front. Neuroinform..

[15]  Jennifer C Kim,et al.  Potential of an Electric Prosthesis for Dynamic Facial Reanimation , 2011, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[16]  Yoshihiro Muraoka,et al.  Feasibility of bionic reanimation of a paralyzed face: a preliminary study of functional electrical stimulation of a paralyzed facial muscle controlled with the electromyography of the contralateral healthy hemiface. , 2010, Plastic and Reconstructive Surgery.

[17]  Pornchai Phukpattaranont,et al.  A Novel Feature Extraction for Robust EMG Pattern Recognition , 2009, ArXiv.

[18]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[19]  Zhizhong Wang,et al.  The application of mutual information-based feature selection and fuzzy LS-SVM-based classifier in motion classification , 2008, Comput. Methods Programs Biomed..

[20]  H. Cabral,et al.  Multiple Comparisons Procedures , 2008, Circulation.

[21]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[22]  C E Shannon,et al.  The mathematical theory of communication. 1963. , 1997, M.D. computing : computers in medical practice.

[23]  F. Berzin,et al.  EMG study of the anterior, superior and posterior auricular muscles in man. , 1993, Annals of anatomy = Anatomischer Anzeiger : official organ of the Anatomische Gesellschaft.

[24]  D. De Grandis,et al.  The electromyographic examination of the posterior auricular muscle. , 1986, Electromyography and clinical neurophysiology.

[25]  N. Berlinger,et al.  Electronic Reanimation of Facial Paralysis—A Feasibility Study , 1986, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[26]  R. L. Iman,et al.  Multiple-comparisons procedures. Informal report , 1979 .

[27]  D Sutton,et al.  Contralaterally Elicited Electrical Stimulation of Paralyzed Facial Muscles , 1978, Otolaryngology.

[28]  L. S. Stone,et al.  An Atlas of Anatomy , 1943, The Yale Journal of Biology and Medicine.

[29]  Robert E. Kearney,et al.  Toward the Bionic Face: A Novel Neuroprosthetic Device Paradigm for Facial Reanimation Consisting of Neural Blockade and Functional Electrical Stimulation , 2019, Plastic and reconstructive surgery.

[30]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[31]  Xiaoyan Li,et al.  Muscle Activity Onset Time Detection Using Teager-Kaiser Energy Operator , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[32]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.