Swallowing detection for game control: Using skin-like electronics to support people with dysphagia

In this paper, we explore the feasibility of developing a sensor-driven rehabilitation game for people suffering from dysphagia. This study utilizes the skin-like electronics for unobtrusive, comfortable, continuous recording of surface electromyograms (EMG) during swallowing and use them for driving game-based, user-controlled feedback. The experimental study includes the development and evaluation of a real-time swallow detection algorithm using skin-like sensors and a game-based human-computer interaction. The user evaluations support the ease of use of the skin-like electronics as a motivational tool for people with dysphagia.

[1]  Yonggang Huang,et al.  Ultrathin conformal devices for precise and continuous thermal characterization of human skin. , 2013, Nature materials.

[2]  Woon-Hong Yeo,et al.  Epidermal Differential Impedance Sensor for Conformal Skin Hydration Monitoring , 2012, Biointerphases.

[3]  Jeonghyun Kim,et al.  An Epidermal Stimulation and Sensing Platform for Sensorimotor Prosthetic Control, Management of Lower Back Exertion, and Electrical Muscle Activation , 2016, Advanced materials.

[4]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Oleksandr Makeyev,et al.  Automatic food intake detection based on swallowing sounds , 2012, Biomed. Signal Process. Control..

[6]  E. Eviatar,et al.  Surface electromyography as a screening method for evaluation of dysphagia and odynophagia , 2009, Head & face medicine.

[7]  Michael R. Neuman,et al.  Automatic Detection of Swallowing Events by Acoustical Means for Applications of Monitoring of Ingestive Behavior , 2010, IEEE Transactions on Biomedical Engineering.

[8]  Raeed H. Chowdhury,et al.  Epidermal Electronics , 2011, Science.

[9]  C. Sapienza,et al.  Strength-Training Exercise in Dysphagia Rehabilitation: Principles, Procedures, and Directions for Future Research , 2007, Dysphagia.

[10]  James J. S. Norton,et al.  Soft, curved electrode systems capable of integration on the auricle as a persistent brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[11]  L. Kirkup,et al.  A direct comparison of wet, dry and insulating bioelectric recording electrodes. , 2000, Physiological measurement.

[12]  L. Rothkrantz,et al.  Toward an affect-sensitive multimodal human-computer interaction , 2003, Proc. IEEE.

[13]  Cara E Stepp,et al.  Surface electromyography for speech and swallowing systems: measurement, analysis, and interpretation. , 2012, Journal of speech, language, and hearing research : JSLHR.

[14]  Edward Sazonov,et al.  Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior. , 2008, Physiological measurement.

[15]  Gerhard Tröster,et al.  On-Body Sensing Solutions for Automatic Dietary Monitoring , 2009, IEEE Pervasive Computing.

[16]  M. Crary,et al.  Functional Benefits of Dysphagia Therapy Using Adjunctive sEMG Biofeedback , 2004, Dysphagia.

[17]  Scholars Compass.  Multifunctional Skin-Like Electronics for Quantitative, Clinical Monitoring of Cutaneous Wound Healing , 2014 .

[18]  Editedby Eleanor Criswell,et al.  Cram's Introduction to Surface Electromyography , 2010 .

[19]  Regan L. Mandryk,et al.  Biofeedback game design: using direct and indirect physiological control to enhance game interaction , 2011, CHI.

[20]  Darryl Charles,et al.  Optimising engagement for stroke rehabilitation using serious games , 2009, The Visual Computer.