User Modelling for Patient Tailored Virtual Rehabilitation

Intelligent rehabilitation is a novel paradigm in motor rehabilitation empowering assistive technology with artificial intelligence (AI). Central to this paradigm is adaptation, the capacity of the assistive technology to dynamically accommodate to the therapy evolving demands. This chapter overviews several existing AI solutions to implement a decision making model to provide rehabilitation tools with adaptation capabilities, and provides details of a powerful approach capable of exploiting prior knowledge for a quick start and posterior knowledge to guarantee up-to-dated informed decisions. In this solution, a Markov decision process formulates an initial policy optimal within prior knowledge; a policy which is later on allow to evolve on incoming evidence to fit new requirements. This solution ensures short training periods and exhibits convergence with therapists’ criteria. In consequence, intelligent adaptation to dynamic circumstances of the patient and therapy plan is demonstrated a feasible endeavour within a real practical timeline. This might endow assistive technology with the necessary competence to be taken home and/or reduce expert surpervision.

[1]  S. Adamovich,et al.  Virtual reality-augmented rehabilitation for patients following stroke. , 2002, Physical therapy.

[2]  P.J.F. Lucas Modelling interactions for diagnosis , 1996 .

[3]  N. Hogan,et al.  Robot‐aided functional imaging: Application to a motor learning study , 1998, Human brain mapping.

[4]  Gil Alterovitz,et al.  Knowledge-Based Bioinformatics: From analysis to interpretation , 2010 .

[5]  Mel Slater,et al.  Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess , 1996, VRST.

[6]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[7]  Andrew Y. Ng,et al.  Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping , 1999, ICML.

[8]  Jennifer Boger,et al.  Creating Intelligent Rehabilitation Technology: An Interdisciplinary Effort * , 2013 .

[9]  Peter J. F. Lucas,et al.  Analysis of Notions of Diagnosis , 1998, Artif. Intell..

[10]  Luis Enrique Sucar,et al.  Adaptive decision models for Virtual Rehabilitation environments , 2013, ICML 2013.

[11]  Jesse Hoey,et al.  Automated Upper Extremity Rehabilitation for Stroke Patients Using a Partially Observable Markov Decision Process , 2008, AAAI Fall Symposium: AI in Eldercare: New Solutions to Old Problems.

[12]  Pascal Poupart,et al.  An Introduction to Fully and Partially Observable Markov Decision Processes , 2012 .

[13]  Felipe Orihuela-Espina,et al.  Patient Tailored Virtual Rehabilitation , 2013 .

[14]  Minhua Ma,et al.  Serious games for movement therapy after stroke , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[15]  E. Tunik,et al.  Sensorimotor training in virtual reality: a review. , 2009, NeuroRehabilitation.

[16]  V Popescu,et al.  Virtual reality-based orthopedic telerehabilitation. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[17]  D.J. Reinkensmeyer,et al.  Automating Arm Movement Training Following Severe Stroke: Functional Exercises With Quantitative Feedback in a Gravity-Reduced Environment , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  L. Enrique Sucar,et al.  Clinical evaluation of a low-cost alternative for stroke rehabilitation , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[19]  T Kuhlen,et al.  Virtual reality for physically disabled people. , 1995, Computers in biology and medicine.

[20]  Patrice L. Weiss,et al.  Textbook of Neural Repair and Rehabilitation: Virtual reality in neurorehabilitation , 2006 .

[21]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[22]  J. Kleim,et al.  Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. , 2008, Journal of speech, language, and hearing research : JSLHR.

[23]  Heidi Sveistrup,et al.  Motor rehabilitation using virtual reality , 2004, Journal of NeuroEngineering and Rehabilitation.

[24]  Darryl Charles,et al.  Serious Games for Upper Limb Rehabilitation Following Stroke , 2009, 2009 Conference in Games and Virtual Worlds for Serious Applications.

[25]  William S. Harwin,et al.  Upper Limb Robot Mediated Stroke Therapy—GENTLE/s Approach , 2003, Auton. Robots.

[26]  Qinyin Qiu,et al.  Journal of Neuroengineering and Rehabilitation Design of a Complex Virtual Reality Simulation to Train Finger Motion for Persons with Hemiparesis: a Proof of Concept Study , 2022 .

[27]  M. Levin Can virtual reality offer enriched environments for rehabilitation? , 2011, Expert review of neurotherapeutics.

[28]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[29]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[30]  David J. Reinkensmeyer,et al.  Gesture Therapy: An Upper Limb Virtual Reality-Based Motor Rehabilitation Platform , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  L. Enrique Sucar,et al.  Gesture therapy: A vision-based system for upper extremity stroke rehabilitation , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[32]  Patrick Olivier,et al.  People, sensors, decisions: Customizable and adaptive technologies for assistance in healthcare , 2012, TIIS.

[33]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[34]  Gazihan Alankus,et al.  Towards customizable games for stroke rehabilitation , 2010, CHI.

[35]  Dragan Gasevic,et al.  Model Driven Engineering and Ontology Development , 2009 .

[36]  Peter D. Klein A Proposed Definition of Propositional Knowledge , 1971 .

[37]  M. Holden,et al.  Virtual Environment Training: A New Tool for Neurorehabilitation , 2002 .

[38]  Eric Rogers,et al.  Research and development work relating to assistive technology 2007–08: Presented to Parliament pursuant to section 22 of the Chronically Sick and Disabled Persons Act 1970 , 2008 .

[39]  Bhaskara Marthi,et al.  Automatic shaping and decomposition of reward functions , 2007, ICML '07.

[40]  Per Backlund,et al.  Gamers against All Odds , 2009, Edutainment.

[41]  S. Adamovich,et al.  Virtual reality physical therapy: a telerehabilitation tool for hand and finger movement exercise monitoring and motor skills analysis , 2005, Proceedings of the IEEE 31st Annual Northeast Bioengineering Conference, 2005..

[42]  Felipe Orihuela-Espina,et al.  Neural Reorganization Accompanying Upper Limb Motor Rehabilitation from Stroke with Virtual Reality-Based Gesture Therapy , 2013, Topics in stroke rehabilitation.

[43]  W. Rymer,et al.  Understanding and treating arm movement impairment after chronic brain injury: progress with the ARM guide. , 2014, Journal of rehabilitation research and development.