A therapy-driven gamification framework for hand rehabilitation

Rehabilitative therapy is usually very expensive and confined to specialized rehabilitation centers or hospitals, leading to slower recovery times for corresponding patients. Therefore, there is a high demand for the development of technology-based personalized solutions to guide and encourage patients towards performing online rehabilitation program that can help them live independently at home. This paper introduces an innovative e-health framework that develops adaptive serious games for people with hand disabilities. The aim of this work is to provide a patient-adaptive environment for the gamification of hand therapies in order to facilitate and encourage rehabilitation issues. Theoretical foundations (i.e., therapy and patient models) and algorithms to match therapy-based hand gestures to navigational movements in 3D space within the serious game environment have been developed. A novel game generation module is introduced, which translates those movements into a 3D therapy-driven route on a real-world map and with different levels of difficulty based on the patient profile and capabilities. In order to enrich the user navigation experience, a 3D spatio-temporal validation region is also generated, which tracks and adjusts the patient movements throughout the session. The gaming environment also creates and adds semantics to different types of attractive and repellent objects in space depending on the difficulty level of the game. Relevant benchmarks to assess the patient interaction with the environment along with a usability and performance testing of our framework are introduced to ensure quantitative as well as qualitative improvements. Trial tests in one disability center were conducted with a total number of five subjects, having hand motor controls problems, who used our gamified physiotherapy solution to help us in measuring the usability and users’ satisfaction levels. The obtained results and feedback from therapists and patients are very encouraging.

[1]  Ben Sawyer.  From Cells to Cell Processors: The Integration of Health and Video Games , 2008, IEEE Computer Graphics and Applications.

[2]  Luca Chittaro,et al.  Personalized emergency medical assistance for disabled people , 2011, User Modeling and User-Adapted Interaction.

[3]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[4]  Mark Gahegan,et al.  MapStats for Kids: Developing and Assessing Web-Based Tools to Foster Geographic and Statistical Literacy in Children , 2003, DG.O.

[5]  D. Fensterheim,et al.  Tele-Rehabilitation using the Rutgers Master II glove following Carpal Tunnel Release surgery , 2006, 2006 International Workshop on Virtual Rehabilitation.

[6]  H Poizner,et al.  Virtual reality-based post-stroke hand rehabilitation. , 2002, Studies in health technology and informatics.

[7]  E. van Lunteren,et al.  Improvement of diaphragm and limb muscle isotonic contractile performance by K+ channel blockade , 2010, Journal of NeuroEngineering and Rehabilitation.

[8]  Minhua Ma,et al.  Serious games for movement therapy after stroke , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[9]  F. Damiani,et al.  Integrative motor, emotive and cognitive therapy for elderly patients chronic post-stroke A feasibility study of the BrightArm™ rehabilitation system , 2011, 2011 International Conference on Virtual Rehabilitation.

[10]  Jacqui Crosbie,et al.  Adaptive Virtual Reality Games for Rehabilitation of Motor Disorders , 2007, HCI.

[11]  Ricky Jacob,et al.  Haptic-GIS: exploring the possibilities , 2010, SIGSPACIAL.

[12]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[13]  Richard W. Bohannon,et al.  Clinical measurement of range of motion. Review of goniometry emphasizing reliability and validity. , 1987, Physical therapy.

[14]  P. Verschure,et al.  Neurorehabilitation using the virtual reality based Rehabilitation Gaming System: methodology, design, psychometrics, usability and validation , 2010, Journal of NeuroEngineering and Rehabilitation.

[15]  Marjorie Skubic,et al.  Mapping Kinect-based in-home gait speed to TUG time: A methodology to facilitate clinical interpretation , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[16]  Susan K. Numrich.  Culture, Models, and Games: Incorporating Warfare's Human Dimension , 2008, IEEE Intelligent Systems.

[17]  Thanassis Rikakis,et al.  A dynamic decision network framework for online media adaptation in stroke rehabilitation , 2008, TOMCCAP.

[18]  Bart Jansen,et al.  Serious games for physical rehabilitation: Designing highly configurable and adaptable games , 2012 .

[19]  Merrilea J. Mayo,et al.  Games for science and engineering education , 2007, CACM.

[20]  Pedro Miguel Moreira,et al.  Serious games for rehabilitation: A survey and a classification towards a taxonomy , 2010, 5th Iberian Conference on Information Systems and Technologies.

[21]  Pier Luca Lanzi,et al.  Self-adaptive games for rehabilitation at home , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[22]  Imad Afyouni,et al.  A Multimedia E-Health Framework Towards An Interactive And Non-Invasive Therapy Monitoring Environment , 2014, ACM Multimedia.

[23]  Cristina V. Lopes,et al.  Free-hand interaction with leap motion controller for stroke rehabilitation , 2014, CHI Extended Abstracts.

[24]  Cuntai Guan,et al.  A feasibility study of non-invasive motor-imagery BCI-based robotic rehabilitation for Stroke patients , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[25]  S-T. Peng,et al.  An Interactive Immersive Serious Game Application for Kunyu Quantu World Map , 2015 .

[26]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[27]  Nadia Hocine,et al.  Adaptation in serious games for upper-limb rehabilitation: an approach to improve training outcomes , 2015, User Modeling and User-Adapted Interaction.

[28]  S. Saini,et al.  A low-cost game framework for a home-based stroke rehabilitation system , 2012, 2012 International Conference on Computer & Information Science (ICCIS).

[29]  Jinxiang Chai,et al.  Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data , 2012, SCA '12.

[30]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[31]  Marko Munih,et al.  Virtual Rehabilitation Environment Using Principles of Intrinsic Motivation and Game Design , 2012, PRESENCE: Teleoperators and Virtual Environments.

[32]  Kiley Sobel,et al.  Stroke rehabilitation with a sensing surface , 2013, CHI.

[33]  Ding Wang,et al.  TouchPoints: an exertion game with strategy , 2014, CHI PLAY.

[34]  Ahmed Lbath,et al.  A GIS-based serious game interface for therapy monitoring , 2014, SIGSPATIAL/GIS.

[35]  Ronald F Zernicke,et al.  Comparison of Home versus Physical Therapy-Supervised Rehabilitation Programs after Anterior Cruciate Ligament Reconstruction , 2005, The American journal of sports medicine.

[36]  David R. Michael,et al.  Serious Games: Games That Educate, Train, and Inform , 2005 .

[37]  Imad Afyouni,et al.  A GIS-based serious game recommender for online physical therapy , 2014, HealthGIS '14.

[38]  Jie Lin,et al.  Parking slot assignment games , 2011, GIS.

[39]  J. Plewes,et al.  Measurement of joint motion: A guide to goniometry , 1986 .

[40]  Nadia Hocine,et al.  Digital-pheromone based difficulty adaptation in post-stroke therapeutic games , 2012, IHI '12.

[41]  Begoña García Zapirain,et al.  Can game-based therapies be trusted? Is game-based education effective? A systematic review of the Serious Games for health and education , 2011, 2011 16th International Conference on Computer Games (CGAMES).

[42]  Marjorie Skubic,et al.  Passive in-home measurement of stride-to-stride gait variability comparing vision and Kinect sensing , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.