Tongue interface based on surface EMG signals of suprahyoid muscles

The research described herein was undertaken to develop and test a novel tongue interface based on classification of tongue motions from the surface electromyography (EMG) signals of the suprahyoid muscles detected at the underside of the jaw. The EMG signals are measured via 22 active surface electrodes mounted onto a special flexible boomerang-shaped base. Because of the sensor’s shape and flexibility, it can adapt to the underjaw skin contour. Tongue motion classification was achieved using a support vector machine (SVM) algorithm for pattern recognition where the root mean square (RMS) features and cepstrum coefficients (CC) features of the EMG signals were analyzed. The effectiveness of the approach was verified with a test for the classification of six tongue motions conducted with a group of five healthy adult volunteer subjects who had normal motor tongue functions. Results showed that the system classified all six tongue motions with high accuracy of 95.1 ± 1.9 %. The proposed method for control of assistive devices was evaluated using a test in which a computer simulation model of an electric wheelchair was controlled using six tongue motions. This interface system, which weighs only 13.6 g and which has a simple appearance, requires no installation of any sensor into the mouth cavity. Therefore, it does not hinder user activities such as swallowing, chewing, or talking. The number of tongue motions is sufficient for the control of most assistive devices.

[1]  M. Ghovanloo Tongue Operated Assistive Technologies , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Y. Sonoda,et al.  Observation of tongue movements employing magnetometer sensor , 1974 .

[3]  Makoto Sasaki,et al.  Estimation of tongue movement based on suprahyoid muscle activity , 2011, 2011 International Symposium on Micro-NanoMechatronics and Human Science.

[4]  Lotte N. S. Andreasen Struijk,et al.  Medical tongue piercing – development and evaluation of a surgical protocol and the perception of procedural discomfort of the participants , 2014, Journal of NeuroEngineering and Rehabilitation.

[5]  S. Krishnan,et al.  Real-Time Classification of Forearm Electromyographic Signals Corresponding to User-Selected Intentional Movements for Multifunction Prosthesis Control , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Ganesh R. Naik,et al.  Twin SVM for Gesture Classification Using the Surface Electromyogram , 2010, IEEE Transactions on Information Technology in Biomedicine.

[7]  Ping Zhou,et al.  High-Density Myoelectric Pattern Recognition Toward Improved Stroke Rehabilitation , 2012, IEEE Transactions on Biomedical Engineering.

[8]  Maysam Ghovanloo,et al.  Introduction and preliminary evaluation of the Tongue Drive System: wireless tongue-operated assistive technology for people with little or no upper-limb function. , 2008, Journal of rehabilitation research and development.

[9]  T. Kuo,et al.  The application of cepstral coefficients and maximum likelihood method in EMG pattern recognition. , 1995, IEEE transactions on bio-medical engineering.

[10]  Maysam Ghovanloo,et al.  Quantitative and Comparative Assessment of Learning in a Tongue-Operated Computer Input Device , 2011, IEEE Transactions on Information Technology in Biomedicine.

[11]  Wai Lam Yoon,et al.  Chin Tuck Against Resistance (CTAR): New Method for Enhancing Suprahyoid Muscle Activity Using a Shaker-type Exercise , 2014, Dysphagia.

[12]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[13]  Desney S. Tan,et al.  Optically sensing tongue gestures for computer input , 2009, UIST '09.

[14]  F. Mcdonald,et al.  Netter's head and neck anatomy for dentistry , 2007, BDJ.

[15]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[16]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[18]  E Fiona Bailey,et al.  Genioglossus and intrinsic electromyographic activities in impeded and unimpeded protrusion tasks. , 2009, Journal of neurophysiology.

[19]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[20]  Incomplete swallowing and retracted tongue maneuvers for electromyographic signal normalization of the extrinsic muscles of the larynx. , 2012, Journal of voice : official journal of the Voice Foundation.

[21]  William J. Hardcastle,et al.  Optopalatograph: real-time feedback of tongue movement in 3D , 1998, ICSLP.

[22]  Danielle Carneiro,et al.  Swallowing in Patients with Parkinson’s Disease: A Surface Electromyography Study , 2012, Dysphagia.

[23]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[24]  J S Kim,et al.  An enhanced feature extraction algorithm for EMG pattern classification. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  Chun-Yi Su,et al.  Boosting-Based EMG Patterns Classification Scheme for Robustness Enhancement , 2013, IEEE Journal of Biomedical and Health Informatics.

[26]  N. Norton,et al.  Netter's Head and Neck Anatomy for Dentistry , 2006 .

[27]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[28]  C Lau,et al.  Comparison of computer interface devices for persons with severe physical disabilities. , 1993, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[29]  Adrian D. C. Chan,et al.  Continuous myoelectric control for powered prostheses using hidden Markov models , 2005, IEEE Transactions on Biomedical Engineering.

[30]  H. Taniguchi,et al.  Effects of food texture and head posture on oropharyngeal swallowing. , 2009, Journal of applied physiology.

[31]  Makoto Sasaki,et al.  Real-time estimation of tongue movement based on suprahyoid muscle activity , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  David J. Beebe,et al.  Development of a Tongue-Operated Switch Array as an Alternative Input Device , 2005 .

[33]  Kazuyo Tanaka,et al.  A myoelectric interface for robotic hand control using support vector machine , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Roberto Merletti,et al.  Electromyography. Physiology, engineering and non invasive applications , 2005 .

[35]  S Micera,et al.  Improving detection of muscle activation intervals. , 2001, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[36]  Junuk Chu,et al.  A Real-Time EMG Pattern Recognition System Based on Linear-Nonlinear Feature Projection for a Multifunction Myoelectric Hand , 2006, IEEE Transactions on Biomedical Engineering.

[37]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[38]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[39]  Satoshi Sasaki,et al.  Development of a Mouthpiece Type Remote Controller for Disabled Persons , 2010 .

[40]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[42]  A. Geurts,et al.  Definition dependent properties of the cortical silent period in upper-extremity muscles, a methodological study , 2014, Journal of NeuroEngineering and Rehabilitation.

[43]  D. Farina,et al.  Spatial Correlation of High Density EMG Signals Provides Features Robust to Electrode Number and Shift in Pattern Recognition for Myocontrol , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  C. Clayton,et al.  Palatal tongue controller , 1992 .

[45]  Lotte N. S. Andreasen Struijk,et al.  An Inductive Tongue Computer Interface for Control of Computers and Assistive Devices , 2006, IEEE Transactions on Biomedical Engineering.