Interactive Reinforcement Learning based Assistive Robot for the Emotional Support of Children

In this work, we challenge the Interactive Reinforcement Learning paradigm by implementing an interactive action-planning module developed with the goal of exploring the feasibility of using a robot to socially engage with children and improve their mood. Facial features of the child are captured and processed, determining their emotional reaction to a behavior performed by the robot. Then, these emotions are classified as affective states in a multi-dimensional model. Leveraging the expertise of a human trainer, the action-planning module interactively learns those actions that are the most appropriate to perform when the child subject is in a specific affective state. To validate the usefulness of the proposed methodology, we evaluated the impact of the robot on elementary school aged children. Our findings show that using this methodology, the robot is able not only to learn in real time from the human trainer through interactions, but also that performing these social actions a robot can improve the mood of children.

[1]  Takanori Shibata,et al.  Living With Seal Robots—Its Sociopsychological and Physiological Influences on the Elderly at a Care House , 2007, IEEE Transactions on Robotics.

[2]  Peter Stone,et al.  Reinforcement learning from human reward: Discounting in episodic tasks , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[3]  Fabio Tesser,et al.  Towards long-term social child-robot interaction , 2016 .

[4]  R. Ketal,et al.  Affect, mood, emotion, and feeling: semantic considerations. , 1975, The American journal of psychiatry.

[5]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[6]  M. Baun,et al.  Physiological Effects of Human/Companion Animal Bonding , 1984, Nursing research.

[7]  Andreas Butz,et al.  Murphy Miserable Robot: A Companion to Support Children's Well-being in Emotionally Difficult Situations , 2016, CHI Extended Abstracts.

[8]  Brigitte Le Pévédic,et al.  Ethological evaluation of human-robot Interaction: Are children more efficient and motivated with computer, virtual agent or robots? , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[9]  Cynthia Breazeal,et al.  Designing a socially assistive robot for pediatric care , 2015, IDC.

[10]  Thomas E. Joiner,et al.  A measure of positive and negative affect for children: Scale development and preliminary validation. , 1999 .

[11]  Sooyeon Jeong,et al.  Developing a social robotic companion for stress and anxiety mitigation in pediatric hospitals , 2014 .

[12]  J. Gammonley,et al.  Pet projects: animal assisted therapy in nursing homes. , 1991, Journal of gerontological nursing.

[13]  Andrea Lockerd Thomaz,et al.  Reinforcement Learning with Human Teachers: Evidence of Feedback and Guidance with Implications for Learning Performance , 2006, AAAI.

[14]  Gregory M. P. O'Hare,et al.  Social interaction between robots, avatars & humans , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[15]  G. Olsson,et al.  Preoperative psychological preparation for children undergoing ENT operations: a comparison of two methods , 2000, Paediatric anaesthesia.

[16]  Rosalind W. Picard,et al.  Empatica E3 — A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition , 2014, 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH).

[17]  Fumihide Tanaka,et al.  Pepper learns together with children: Development of an educational application , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[18]  Fabio Tesser,et al.  Multimodal child-robot interaction: building social bonds , 2013, HRI 2013.