New Approaches to Exciting Exergame-Experiences for People with Motor Function Impairments

The work presented here suggests new ways to tackle exergames for physical rehabilitation and to improve the players’ immersion and involvement. The primary (but not exclusive) purpose is to increase the motivation of children and adolescents with severe physical impairments, for doing their required exercises while playing. The proposed gaming environment is based on the Kinect sensor and the Blender Game Engine. A middleware has been implemented that efficiently transmits the data from the sensor to the game. Inside the game, different newly proposed mechanisms have been developed to distinguish pure exercise-gestures from other movements used to control the game (e.g., opening a menu). The main contribution is the amplification of weak movements, which allows the physically impaired to have similar gaming experiences as the average population. To test the feasibility of the proposed methods, four mini-games were implemented and tested by a group of 11 volunteers with different disabilities, most of them bound to a wheelchair. Their performance has also been compared to that of a healthy control group. Results are generally positive and motivating, although there is much to do to improve the functionalities. There is a major demand for applications that help to include disabled people in society and to improve their life conditions. This work will contribute towards providing them with more fun during exercise.

[1]  Adam Evans,et al.  Creating wheelchair-controlled video games: Challenges and opportunities when involving young people with mobility impairments and game design experts , 2016, Int. J. Hum. Comput. Stud..

[2]  Carmen E. Quatman,et al.  Commercially available gaming systems as clinical assessment tools to improve value in the orthopaedic setting: a systematic review. , 2015, Injury.

[3]  A. Roy,et al.  Enhancing effectiveness of motor rehabilitation using kinect motion sensing technology , 2013, 2013 IEEE Global Humanitarian Technology Conference: South Asia Satellite (GHTC-SAS).

[4]  M. Grootenhuis,et al.  Living with muscular dystrophy: health related quality of life consequences for children and adults , 2007, Health and quality of life outcomes.

[5]  Enrique M. Albornoz,et al.  Development of a Kinect-based exergaming system for motor rehabilitation in neurological disorders , 2016 .

[6]  Hossein Mousavi Hondori,et al.  A Review on Technical and Clinical Impact of Microsoft Kinect on Physical Therapy and Rehabilitation , 2014, Journal of medical engineering.

[7]  J E Deutsch,et al.  Feasibility, safety and outcomes of playing Kinect Adventures!™ for people with Parkinson's disease: a pilot study. , 2014, Physiotherapy.

[8]  Pilwon Hur,et al.  Usability evaluation of low-cost virtual reality hand and arm rehabilitation games. , 2016, Journal of rehabilitation research and development.

[9]  Pier Luca Lanzi,et al.  An intelligent game engine for the at-home rehabilitation of stroke patients , 2013, 2013 IEEE 2nd International Conference on Serious Games and Applications for Health (SeGAH).

[10]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[11]  Vitor Carvalho,et al.  A serious game for rehabilitation of neurological disabilities: Premilinary study , 2015, 2015 IEEE 4th Portuguese Meeting on Bioengineering (ENBENG).

[12]  Mohamed Abdur Rahman,et al.  Multimedia interactive therapy environment for children having physical disabilities , 2013, ICMR.

[13]  Pier Luca Lanzi,et al.  Self-adaptive games for rehabilitation at home , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[14]  Beatrix Vereijken,et al.  Exercise and rehabilitation delivered through exergames in older adults: An integrative review of technologies, safety and efficacy , 2016, Int. J. Medical Informatics.

[15]  Juan M. Meneses,et al.  A modular middleware approach for exergaming , 2016, 2016 IEEE 6th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[16]  H. F. Machiel Van der Loos,et al.  Usability testing of gaming and social media applications for stroke and cerebral palsy upper limb rehabilitation , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Martina Eckert,et al.  MoKey: A versatile exergame creator for everyday usage , 2019, Assistive technology : the official journal of RESNA.

[18]  Kelly J. Bower,et al.  Clinical feasibility of interactive motion-controlled games for stroke rehabilitation , 2015, Journal of NeuroEngineering and Rehabilitation.

[19]  Kathrin Maria Gerling,et al.  Exploring Casual Exergames with Kids Using Wheelchairs , 2015, CHI PLAY.

[20]  Marcos Cordeiro d'Ornellas,et al.  Thoroughly Approach to Upper Limb Rehabilitation Using Serious Games for Intensive Group Physical Therapy or Individual Biofeedback Training , 2014, 2014 Brazilian Symposium on Computer Games and Digital Entertainment.

[21]  Shang-Ti Chen,et al.  Using Xbox 360 Kinect Games on Enhancing Visual Performance Skills on Institutionalized Older Adults with Wheelchairs , 2012, 2012 IEEE Fourth International Conference On Digital Game And Intelligent Toy Enhanced Learning.

[22]  Octavian Postolache,et al.  PhysioMate - Pervasive physical rehabilitation based on NUI and gamification , 2014, 2014 International Conference and Exposition on Electrical and Power Engineering (EPE).

[23]  Fillia Makedon,et al.  A game system for remote rehabilitation of cerebral palsy patients , 2012, PETRA '12.

[24]  P. Olivier,et al.  Retraining function in people with Parkinson’s disease using the Microsoft kinect: game design and pilot testing , 2014, Journal of NeuroEngineering and Rehabilitation.

[25]  Kelly Anderson,et al.  Virtual reality video games to promote movement recovery in stroke rehabilitation: a guide for clinicians. , 2015, Archives of physical medicine and rehabilitation.

[26]  Sing Kai Lo,et al.  Joint range of motion limitations in children and young adults with spinal muscular atrophy. , 2004, Archives of physical medicine and rehabilitation.

[27]  Juan M. Meneses,et al.  A multi functional plug-in for exergames , 2015, 2015 International Symposium on Consumer Electronics (ISCE).

[28]  Francisco Javier Díaz-Pernas,et al.  Rehabilitation Using Kinect-based Games and Virtual Reality☆ , 2015 .

[29]  Begoña García Zapirain,et al.  JeWheels: Kinect Based Serious Game Aimed at Wheelchair Users , 2012, IWAAL.

[30]  Rui Rodrigues,et al.  Natural User Interfaces in the Motor Development of Disabled Children , 2014 .

[31]  Mei-Hsiang Chen,et al.  Developing a Digital Game for Domestic Stroke Patients' Upper Extremity Rehabilitation - Design and Usability Assessment , 2015, HCI.

[32]  Bruno Bonnechère,et al.  The use of commercial video games in rehabilitation: a systematic review , 2016, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[33]  Yu-kai Chou,et al.  Actionable Gamification: Beyond Points, Badges, and Leaderboards , 2015 .

[34]  Alfredo Pina,et al.  Designing Educational Tools, Based on Body Interaction, for Children with Special Needs Who Present Different Motor Skills , 2014, 2014 International Conference on Interactive Technologies and Games.

[35]  Laura Luna-Oliva,et al.  Kinect Xbox 360 as a therapeutic modality for children with cerebral palsy in a school environment: a preliminary study. , 2013, NeuroRehabilitation.

[36]  J. Miangolarra-Page,et al.  A Telerehabilitation Program Improves Postural Control in Multiple Sclerosis Patients: A Spanish Preliminary Study , 2013, International journal of environmental research and public health.

[37]  Darryl Charles,et al.  Optimising engagement for stroke rehabilitation using serious games , 2009, The Visual Computer.

[38]  Takashi Masuda,et al.  KINECT applications for the physical rehabilitation , 2013, 2013 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[39]  José-Fernán Martínez-Ortega,et al.  MoKey - A motion based keyboard interpreter , 2015, 2015 International Symposium on Consumer Electronics (ISCE).

[40]  Roberto Cano de la Cuerda,et al.  A telerehabilitation program by virtual reality-video games improves balance and postural control in multiple sclerosis patients. , 2013, NeuroRehabilitation.

[41]  Antoni Jaume-i-Capó,et al.  Design Issues for Vision-Based Motor-Rehabilitation Serious Games , 2014, Technologies of Inclusive Well-Being.

[42]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.