ExerciseCheck: a scalable platform for remote physical therapy deployed as a hybrid desktop and web application

ExerciseCheck is a scalable, accessible platform designed and developed for the remote monitoring and evaluation of physical therapy. Physical rehabilitation is an important aspect of a patient's recovery from injury and often requires the patient to perform a prescribed set of exercises over medium- to long-term periods. In the absence of a physical therapist, using a low-cost, non-intrusive solution can serve as a complement to in-clinic sessions and provide patients with valuable insights into their exercises. We present the design, implementation, and deployment of ExerciseCheck, a modular system that incorporates machine learning techniques with contemporary web technologies to enable a user-friendly experience for patients and physical therapists. Initially a proof-of-concept, the latest version of ExerciseCheck is now deployed as a hybrid desktop and web application at a Boston University rehabilitation clinic and has been employed by physical therapists in their sessions with individuals with Parkinson's disease. We provide insights into the usability requirements, architecture design, and implementation challenges of the development and deployment of a production-quality platform for remote physical therapy in a clinical setting.

[1]  Albert A. Rizzo,et al.  Interactive game-based rehabilitation using the Microsoft Kinect , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[2]  Gang Wang,et al.  Feature Boosting Network For 3D Pose Estimation , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Sönke Johannes,et al.  Physiotherapy after traumatic brain injury: A systematic review of the literature , 2008, Brain injury.

[4]  Hans-Peter Seidel,et al.  VNect , 2017, ACM Trans. Graph..

[5]  Xu Xu,et al.  Toward Marker-Free 3D Pose Estimation in Lifting: A Deep Multi-View Solution , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[6]  Kasch Mc.  Hand rehabilitation. , 1986, Hand clinics.

[7]  J.E. Deutsch,et al.  Wii-based compared to standard of care balance and mobility rehabilitation for two individuals post-stroke , 2009, 2009 Virtual Rehabilitation International Conference.

[8]  Margrit Betke,et al.  ExerciseCheck: data analytics for a remote monitoring and evaluation platform for home-based physical therapy , 2019, PETRA.

[9]  R W Bohannon,et al.  Physical rehabilitation in neurologic diseases. , 1993, Current opinion in neurology.

[10]  Peter Johannes Schulz,et al.  The Effect of Social Support Features and Gamification on a Web-Based Intervention for Rheumatoid Arthritis Patients: Randomized Controlled Trial , 2015, Journal of medical Internet research.

[11]  L. Enrique Sucar,et al.  Gesture therapy: A vision-based system for upper extremity stroke rehabilitation , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[12]  John D. Steeves,et al.  Computer vision-based classification of hand grip variations in neurorehabilitation , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[13]  Vangelis Metsis,et al.  Quantitative evaluation of the kinect skeleton tracker for physical rehabilitation exercises , 2014, PETRA '14.

[14]  Eleni Stroulia,et al.  VirtualGym: A kinect-based system for seniors exercising at home , 2018, Entertain. Comput..

[15]  F. Makedon,et al.  A Survey of Assistive Technologies for Assessment and Rehabilitation of Motor Impairments in Multiple Sclerosis , 2019, Multimodal Technol. Interact..

[16]  Joaquim Gabriel,et al.  Kinect system in home-based cardiovascular rehabilitation , 2017, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[17]  Gargin Otr,et al.  Wii-HAB: Using the Wii Video Game System as an Occupational Therapy Intervention with Patients in the Hospital Setting , 2010 .

[18]  Xia Shen,et al.  Long-term effects of exercise and physical therapy in people with Parkinson disease , 2017, Nature Reviews Neurology.

[19]  Alan D. Lopez,et al.  The Global Burden of Disease Study , 2003 .

[20]  Alon Wolf,et al.  An Adaptive Home-Use Robotic Rehabilitation System for the Upper Body , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[21]  Vangelis Metsis,et al.  Development and evaluation of a unity-based, kinect-controlled avatar for physical rehabilitation , 2015, PETRA.

[22]  Siew Wen Chin,et al.  Game-based human computer interaction using gesture recognition for rehabilitation , 2013, 2013 IEEE International Conference on Control System, Computing and Engineering.

[23]  Lisa Anthony,et al.  Using the kinect to encourage older adults to exercise: a prototype , 2012, CHI Extended Abstracts.

[24]  Hiroshi Yokoi,et al.  Development of hand rehabilitation system for paralysis patient – universal design using wire-driven mechanism – , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  TeichriebVeronica,et al.  Motor Rehabilitation Using Kinect: A Systematic Review , 2015 .

[26]  Xiong Luo,et al.  Rule-Based Human Motion Tracking for Rehabilitation Exercises: Realtime Assessment, Feedback, and Guidance , 2017, IEEE Access.

[27]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[28]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[29]  Sri Hastuti Kurniawan,et al.  An immersive physical therapy game for stroke survivors , 2014, ASSETS.

[30]  Ana-Maria Cretu,et al.  Human movement quantification using Kinect for in-home physical exercise monitoring , 2014, 2014 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[31]  Darryl Charles,et al.  Optimising engagement for stroke rehabilitation using serious games , 2009, The Visual Computer.

[32]  Qingxiang Wang,et al.  Design of the workstation for hand rehabilitation based on data glove , 2010, 2010 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[33]  Margrit Betke,et al.  The Kinect Versus The Proficio: Measuring Hand Position During Exercise Monitoring , 2016, PETRA.

[34]  Todd H. Stokes,et al.  Kinect-based rehabilitation system for patients with traumatic brain injury , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[35]  A. Krichevets,et al.  Computer games as a means of movement rehabilitation. , 1995, Disability and rehabilitation.

[36]  Cathi A Thomas,et al.  Comparative Effectiveness of mHealth-Supported Exercise Compared With Exercise Alone for People With Parkinson Disease: Randomized Controlled Pilot Study , 2019, Physical therapy.

[37]  A. Rizzo,et al.  Initial usability assessment of off-the-shelf video game consoles for clinical game-based motor rehabilitation , 2009 .

[38]  Nassir Navab,et al.  Motor Rehabilitation Using Kinect: A Systematic Review. , 2015, Games for health journal.

[39]  Dan J Stein,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013 , 2015, The Lancet.

[40]  Martin Schätz,et al.  Motion tracking and gait feature estimation for recognising Parkinson’s disease using MS Kinect , 2015, BioMedical Engineering OnLine.

[41]  Kevin M. Cury,et al.  DeepLabCut: markerless pose estimation of user-defined body parts with deep learning , 2018, Nature Neuroscience.

[42]  Fillia Makedon,et al.  MAGNI Dynamics: A Vision-Based Kinematic and Dynamic Upper-Limb Model for Intelligent Robotic Rehabilitation , 2017 .

[43]  Gazihan Alankus,et al.  Stroke Therapy through Motion-Based Games: A Case Study , 2010, TACC.

[44]  Eamonn Keogh.  Exact Indexing of Dynamic Time Warping , 2002, VLDB.

[45]  Raja Vikram Reddy,et al.  Hand Rehabilitation Glove , 2018, International Journal of Trend in Scientific Research and Development.

[46]  Margrit Betke,et al.  ExerciseCheck: Remote Monitoring and Evaluation Platform for Home Based Physical Therapy , 2017, PETRA.