An Optimization Approach for Structured Agent-Based Provider/Receiver Tasks

This work contributes an optimization framework in the context of structured interactions between an agent playing the role of a 'provider' and a human 'receiver'. Examples of provider/receiver interactions of interest include ones between occupational therapist and patient, or teacher and student. We specifically consider tasks where the provider agent needs to plan a sequence of actions with a fixed horizon, where actions are organized along a hierarchy with increasing probabilities of success and associated costs. The goal of the provider is to achieve a success with the lowest expected cost possible. In our application domains, a success may be for instance eliciting a desired behavior or a correct response from the receiver. We present a linear-time optimal planning algorithm that generates cost-optimal sequences for given action parameters. We also provide proofs for a number of properties of optimal solutions that align with typical human provider strategies. Finally, we instantiate our general formulation in the context of robot-assisted therapy tasks for children with Autism Spectrum Disorders (ASD). In this context, we present methods for determining action parameters, namely (1) an online survey with experts for determining action costs, and (2) a probabilistic model of child response based on data collected in a real child-robot interaction scenario. Our contributions may unlock increased levels of adaptivity for agents introduced in a variety of assistive contexts.

[1]  Mohamed Chetouani,et al.  A multimodal and multilevel system for robotics treatment of autism in children , 2016, DAA '16.

[2]  Albert T. Corbett,et al.  Intelligent Tutoring Systems , 1985, Science.

[3]  Iolanda Leite,et al.  Long-term interactions with empathic social robots , 2015, SIGAI.

[4]  Chih-Wei Chang,et al.  A Robot as a Teaching Assistant in an English Class , 2006 .

[5]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[6]  Tiffany Barnes,et al.  Toward Automatic Hint Generation for Logic Proof Tutoring Using Historical Student Data , 2008, Intelligent Tutoring Systems.

[7]  Rosemary Luckin,et al.  Artificial Intelligence in Education, Building Technology Rich Learning Contexts That Work, Proceedings of the 13th International Conference on Artificial Intelligence in Education, AIED 2007, July 9-13, 2007, Los Angeles, California, USA , 2007, AIED.

[8]  Brian Scassellati,et al.  Socially assistive robotics [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[9]  Shaobo Huang,et al.  How to train your DragonBot: Socially assistive robots for teaching children about nutrition through play , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Tom Ziemke,et al.  How to Build a Supervised Autonomous System for Robot-Enhanced Therapy for Children with Autism Spectrum Disorder , 2017, Paladyn J. Behav. Robotics.

[11]  Nancy K. Lamport,et al.  Activity Analysis: Application to Occupation , 2005 .

[12]  Ana Paiva,et al.  An Approach for Personalized Social Inter- actions Between a Therapeutic Robot and Children with Autism Spectrum Disorder , 2019 .

[13]  Subbarao Kambhampati,et al.  What can Automated Planning do for Intelligent Tutoring Systems ? , 2018 .

[14]  高橋 栄 Diagnostic and Statistical Manual of Mental Disorders(DSM)-5による分類と診断 (特集 周産期メンタルヘルス : 妊婦の不安とどう立ち向かうか) , 2014 .

[15]  Eric Horvitz,et al.  Agents With Beliefs: Reflections on Bayesian Methods for User Modeling , 1997 .

[16]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[17]  Kurt VanLehn,et al.  A Comparison of Decision-Theoretic, Fixed-Policy and Random Tutorial Action Selection , 2006, Intelligent Tutoring Systems.

[18]  Siddhartha S. Srinivasa,et al.  Human-Robot Mutual Adaptation in Shared Autonomy , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[19]  Sarel van Vuuren,et al.  A Virtual Therapist for Speech and Language Therapy , 2014, IVA.

[20]  H. Head Aphasia and kindred disorders of speech , 1926 .

[21]  Ana Paiva,et al.  Developing Learning Scenarios to Foster Children's Handwriting Skills with the Help of Social Robots , 2017, HRI.

[22]  Ki-Hun Cho,et al.  Is robot-assisted therapy effective in upper extremity recovery in early stage stroke? —a systematic literature review , 2017, Journal of physical therapy science.

[23]  Changchun Liu,et al.  Affect-sensitive assistive intervention technologies for children with autism: An individual-specific approach , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[24]  Pierre-Yves Oudeyer,et al.  Online Optimization of Teaching Sequences with Multi-Armed Bandits , 2014, EDM.

[25]  Cristina Conati,et al.  Empirically building and evaluating a probabilistic model of user affect , 2009, User Modeling and User-Adapted Interaction.

[26]  Kenneth R. Koedinger,et al.  Data-Driven Hint Generation in Vast Solution Spaces: a Self-Improving Python Programming Tutor , 2015, International Journal of Artificial Intelligence in Education.

[27]  C. Lord,et al.  Autism Diagnostic Observation Schedule , 2016 .

[28]  Craig W. Linebaugh,et al.  Cueing Hierarchies and Word Retrieval: A Therapy Program , 1977 .

[29]  A. Mihailidis,et al.  Assistive technology for cognitive rehabilitation: State of the art , 2004 .

[30]  Albert A. Rizzo,et al.  Virtual humans for assisted health care , 2008, PETRA '08.

[31]  N. Sarkar,et al.  Can Robotic Interaction Improve Joint Attention Skills? , 2015, Journal of autism and developmental disorders.