Enabling AI and Robotic Coaches for Physical Rehabilitation Therapy: Iterative Design and Evaluation with Therapists and Post-Stroke Survivors

Artificial intelligence (AI) and robotic coaches promise the improved engagement of patients on rehabilitation exercises through social interaction. While previous work explored the potential of automatically monitoring exercises for AI and robotic coaches, the deployment of these systems remains a challenge. Previous work described the lack of involving stakeholders to design such functionalities as one of the major causes. In this paper, we present our efforts on eliciting the detailed design specifications on how AI and robotic coaches could interact with and guide patient’s exercises in an effective and acceptable way with four therapists and five post-stroke survivors. Through iterative questionnaires and interviews, we found that both poststroke survivors and therapists appreciated the potential benefits of AI and robotic coaches to achieve more systematic management and improve their self-efficacy and motivation on rehabilitation therapy. In addition, our evaluation sheds light on several practical concerns (e.g. a possible difficulty with the interaction for people with cognitive impairment, system failures, etc.). We discuss the value of early involvement of stakeholders and interactive techniques that complement system failures, but also support a personalized therapy session for the better deployment of AI and robotic exercise coaches. Min Hun Lee, Daniel P. Siewiorek, and Asim Smailagic Carnegie Mellon University E-mail: {minhunl, dps, asim}@cs.cmu.edu Alexandre Bernardino Instituto Superior Técnico E-mail: alex@isr.tecnico.ulisboa.pt Sergi Bermúdez i Badia University of Madeira, Madeira-ITI, NOVA-LINCS E-mail: sergi.bermudez@m-iti.org

[1]  Veton Kepuska,et al.  Comparing Speech Recognition Systems (Microsoft API, Google API And CMU Sphinx) , 2017 .

[2]  Gazihan Alankus,et al.  Towards customizable games for stroke rehabilitation , 2010, CHI.

[3]  Maja J. Mataric,et al.  Effects of comparative feedback from a Socially Assistive Robot on self-efficacy in post-stroke rehabilitation , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[4]  Adriana Tapus,et al.  User—robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy , 2008, Intell. Serv. Robotics.

[5]  Cynthia Breazeal,et al.  The Challenges of Working on Social Robots that Collaborate with People , 2019, CHI Extended Abstracts.

[6]  Pierre Blazevic,et al.  The NAO humanoid: a combination of performance and affordability , 2008, ArXiv.

[7]  M. Schuurmans,et al.  Task-oriented training in rehabilitation after stroke: systematic review. , 2009, Journal of advanced nursing.

[8]  Maya Cakmak,et al.  Enabling building service robots to guide blind people a participatory design approach , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[10]  J. Cunha,et al.  Movement Quantification in Neurological Diseases: Methods and Applications. , 2016, IEEE reviews in biomedical engineering.

[11]  Maja J. Mataric,et al.  Encouraging physical therapy compliance with a hands-Off mobile robot , 2006, HRI '06.

[12]  Sao Mai Nguyen,et al.  Computational architecture of a robot coach for physical exercises in kinaesthetic rehabilitation , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[13]  Ronit Feingold Polak,et al.  Social Robot for Rehabilitation: Expert Clinicians and Post-Stroke Patients' Evaluation Following a Long-Term Intervention , 2020 .

[14]  Laurel D. Riek,et al.  Healthcare robotics , 2017, Commun. ACM.

[15]  David J. Reinkensmeyer,et al.  Rehabilitation and Health Care Robotics , 2016, Springer Handbook of Robotics, 2nd Ed..

[16]  Jason R. Wilson,et al.  Challenges in Designing a Fully Autonomous Socially Assistive Robot for People with Parkinson’s Disease , 2020, ACM Transactions on Human-Robot Interaction.

[17]  Wan Ling Chang,et al.  Steps Toward Participatory Design of Social Robots: Mutual Learning with Older Adults with Depression , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[18]  Michelle J. Johnson,et al.  Advances in upper limb stroke rehabilitation: a technology push , 2011, Medical & Biological Engineering & Computing.

[19]  Tamilyn Bakas,et al.  Barriers and Facilitators to Exercise Among Stroke Survivors , 2007, Rehabilitation nursing : the official journal of the Association of Rehabilitation Nurses.

[20]  A. Long,et al.  Rehabilitation practice: challenges to effective team working. , 2003, International journal of nursing studies.

[21]  Paul Bremner,et al.  Social Robots for Engagement in Rehabilitative Therapies: Design Implications from a Study with Therapists , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  S. Wyke,et al.  Implementing a framework for goal setting in community based stroke rehabilitation: a process evaluation , 2013, BMC Health Services Research.

[23]  M. Fitter Towards more “natural” interactive systems , 1979 .

[24]  Sheng Quan Xie,et al.  Exoskeleton robots for upper-limb rehabilitation: state of the art and future prospects. , 2012, Medical engineering & physics.

[25]  Daniel P. Siewiorek,et al.  Learning to assess the quality of stroke rehabilitation exercises , 2019, IUI.

[26]  Maja J Matarić,et al.  Socially Assistive Robotics for Post-stroke Rehabilitation Journal of Neuroengineering and Rehabilitation Socially Assistive Robotics for Post-stroke Rehabilitation , 2007 .

[27]  P. Celnik,et al.  Stroke Rehabilitation. , 2015, Physical medicine and rehabilitation clinics of North America.

[28]  Daniel P. Siewiorek,et al.  Towards Personalized Interaction and Corrective Feedback of a Socially Assistive Robot for Post-Stroke Rehabilitation Therapy , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[29]  Corby K. Martin,et al.  Feasibility, Reliability, and Validity of a Smartphone Based Application for the Assessment of Cognitive Function in the Elderly , 2013, PloS one.

[30]  Maria Burton,et al.  Interventions for enhancing adherence with physiotherapy: a systematic review. , 2010, Manual therapy.

[31]  Stefan Winkler,et al.  Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning , 2015, ICMI.

[32]  P. Duncan,et al.  Fugl-Meyer Assessment of Sensorimotor Function After Stroke: Standardized Training Procedure for Clinical Practice and Clinical Trials , 2011, Stroke.

[33]  N. Kayes,et al.  Barriers and facilitators to engagement in rehabilitation for people with stroke: a review of the literature , 2013 .

[34]  G. Kwakkel,et al.  The impact of physical therapy on functional outcomes after stroke: what's the evidence? , 2004, Clinical rehabilitation.

[35]  Brian Caulfield,et al.  Patient Involvement With Home-Based Exercise Programs: Can Connected Health Interventions Influence Adherence? , 2018, JMIR mHealth and uHealth.

[36]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[37]  Steve Wheeler,et al.  How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX , 2011, Biomedical engineering online.

[38]  Markus Vincze,et al.  Results of a real world trial with a mobile social service robot for older adults , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[39]  John C. Fortney,et al.  A Re-conceptualization of Access for 21st Century Healthcare , 2011, Journal of General Internal Medicine.

[40]  Kallirroi Georgila,et al.  SimSensei kiosk: a virtual human interviewer for healthcare decision support , 2014, AAMAS.

[41]  Van Peppen,et al.  The impact of physical therapy on functional outcomes after stroke : what ’ s the evidence ? , 2004 .

[42]  B. Mcmahon,et al.  Deficit awareness and treatment performance among traumatic head injury adults. , 1988, Brain injury.

[43]  Juan Fasola,et al.  A socially assistive robot exercise coach for the elderly , 2013, J. Hum. Robot Interact..

[44]  N. Gale,et al.  Using the framework method for the analysis of qualitative data in multi-disciplinary health research , 2013, BMC Medical Research Methodology.

[45]  A. Gorgey Robotic exoskeletons: The current pros and cons , 2018, World journal of orthopedics.

[46]  Mariko Carey,et al.  Interventions to aid patient adherence to physiotherapist prescribed self-management strategies: a systematic review. , 2016, Physiotherapy.

[47]  K. Tham,et al.  Functioning in everyday life after stroke: a longitudinal study of elderly people receiving rehabilitation at home. , 2007, Scandinavian journal of caring sciences.

[48]  Joseph Sharit,et al.  Factors predicting the use of technology: findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE). , 2006, Psychology and aging.

[49]  J. Fleming,et al.  Self-Awareness of Deficits following Acquired Brain Injury: Considerations for Rehabilitation , 1995 .

[50]  Boris E. R. de Ruyter,et al.  Benefits of Social Intelligence in Home Dialogue Systems , 2005, INTERACT.

[51]  Bruno Maisonnier,et al.  Choregraphe: a graphical tool for humanoid robot programming , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[52]  Jenay M. Beer,et al.  The domesticated robot: Design guidelines for assisting older adults to age in place , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  Derick T Wade,et al.  Goal setting in rehabilitation: an overview of what, why and how , 2009, Clinical rehabilitation.

[54]  Sandeep K Subramanian,et al.  Virtual reality environments for post-stroke arm rehabilitation , 2007, Journal of NeuroEngineering and Rehabilitation.