MyoBeatz: Using music and rhythm to improve prosthetic control in a mobile game for health

The control of a myoelectric prosthesis requires extensive rehabilitative training based on repetitive exercises. But at home, many patients lack the motivation to continue the physiotherapy exercises. Mobile games on a smartphone can contribute to a long-term motivation to continue home training with the necessary intensity. The patients control the game with their muscle signals, exactly how they would control their actual prosthesis. In this study, we examined the usability of the gaming system, its functionality and subjective quality. It was rated highly in all aspects by both experimental groups, with the patient group consistently rating higher than the able-bodied group. Although highly rated, results showed detailed potential for improvement regarding the aesthetics of the app and provided information in-app. The mobile training app not only provides feedback on the correct execution of muscle activation, but also maintains the patient’s motivation through various feedback elements. In a clinical pilot study, three upper limb amputees trained their neuromuscular control over the course of four weeks while playing the game and clinical parameters important for prosthetic control have been evaluated pre and post intervention. Significant improvements could be seen in all assessed parameters which supports the thesis that a game-based mobile app can be used to train EMG motor signals for prosthetic control.

[1]  Ozlem Ulger,et al.  The importance of rehabilitation concerning upper extremity amputees: A Systematic review , 2016, Pakistan journal of medical sciences.

[2]  Raoul M. Bongers,et al.  Task-Oriented Gaming for Transfer to Prosthesis Use , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Naznin Virji-Babul,et al.  Therapists’ Perceptions of Social Media and Video Game Technologies in Upper Limb Rehabilitation , 2015, JMIR serious games.

[4]  Fares Kayali,et al.  PlayBionic: Game‐Based Interventions to Encourage Patient Engagement and Performance in Prosthetic Motor Rehabilitation , 2018, PM & R : the journal of injury, function, and rehabilitation.

[5]  Shawn Swanson Johnson,et al.  Prosthetic training: upper limb. , 2014, Physical medicine and rehabilitation clinics of North America.

[6]  David J. Reinkensmeyer,et al.  "If I can't do it once, why do it a hundred times?": Connecting volition to movement success in a virtual environment motivates people to exercise the arm after stroke , 2007, 2007 Virtual Rehabilitation.

[7]  Walter F. Bischof,et al.  Activities and Evaluations for Technology-Based Upper Extremity Rehabilitation , 2016 .

[8]  Walter F. Bischof,et al.  Augmented reality improves myoelectric prosthesis training , 2014 .

[9]  Oksana Zelenko,et al.  Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps , 2015, JMIR mHealth and uHealth.

[10]  K. Sethi,et al.  Nintendo Wii rehabilitation ("Wii-hab") provides benefits in Parkinson's disease. , 2013, Parkinsonism & related disorders.

[11]  Aidan D. Roche,et al.  Prosthetic Myoelectric Control Strategies: A Clinical Perspective , 2014, Current Surgery Reports.

[12]  Nassir Navab,et al.  Upbeat: Augmented Reality-Guided Dancing for Prosthetic Rehabilitation of Upper Limb Amputees , 2019, Journal of healthcare engineering.

[13]  Raoul M. Bongers,et al.  Virtual Training of the Myosignal , 2015, PloS one.

[14]  Fares Kayali,et al.  Recommendations for Games to Increase Patient Motivation During Upper Limb Amputee Rehabilitation , 2017 .

[15]  Cosima Prahm,et al.  Rehabilitation of Upper Extremity Nerve Injuries Using Surface EMG Biofeedback: Protocols for Clinical Application , 2018, Front. Neurosci..

[16]  Peter A. Smith,et al.  Usability testing games for prosthetic training , 2018, 2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH).

[17]  Mitchell Ruble,et al.  Mobile, Game-Based Training for Myoelectric Prosthesis Control , 2018, Front. Bioeng. Biotechnol..

[18]  Stoyan R. Stoyanov,et al.  Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS) , 2016, JMIR mHealth and uHealth.

[19]  Oskar C. Aszmann,et al.  Functional and Psychosocial Outcomes of Hand Transplantation Compared with Prosthetic Fitting in Below-Elbow Amputees: A Multicenter Cohort Study , 2016, PloS one.

[20]  Joel C. Perry,et al.  Improving patient motivation in game development for motor deficit rehabilitation , 2008, ACE '08.

[21]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[22]  C. Colomer,et al.  Effectiveness of a Wii balance board-based system (eBaViR) for balance rehabilitation: a pilot randomized clinical trial in patients with acquired brain injury , 2011, Journal of NeuroEngineering and Rehabilitation.

[23]  Peter Purgathofer,et al.  Game-Based Rehabilitation for Myoelectric Prosthesis Control , 2017, JMIR serious games.

[24]  Raoul M Bongers,et al.  Intermanual Transfer in Training With an Upper-Limb Myoelectric Prosthesis Simulator: A Mechanistic, Randomized, Pretest-Posttest Study , 2012, Physical Therapy.

[25]  Farbod Fahimi,et al.  Myoelectric training systems , 2011, Expert review of medical devices.

[26]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[27]  Anna Pittermann,et al.  The Vienna psychosocial assessment procedure for bionic reconstruction in patients with global brachial plexus injuries , 2018, PloS one.