Towards metrics of Evaluation of Pepper robot as a Social Companion for Elderly People

For the design of socially acceptable robots, field studies in Human-Robot Interaction are necessary. Constructing dialogue benchmarks can have a meaning only if researchers take into account the evaluation of robot, human, and their interaction. This paper describes a study aiming at finding an objective evaluation procedure of the dialogue with a social robot. The goal is to build an empathic robot (JOKER project) and it focuses on elderly people, the end-users expected by ROMEO2 project. The authors carried out three experimental sessions. The first time, the robot was NAO, and it was with a Wizard of Oz (emotions were entered manually by experimenters as inputs to the program). The other times, the robot was Pepper, and it was totally autonomous (automatic detection of emotions and decision according to). Each interaction involved various scenarios dealing with emotion recognition, humor, negotiation and cultural quiz. The paper details the system functioning, the scenarios and the evaluation of the experiments. Mélanie Garcia LIMSI-CNRS, Université Paris-Saclay, Orsay, France, e-mail: garcia@limsi.fr Lucile Béchade LIMSI-CNRS, Université Paris-Saclay, Orsay, France e-mail: lucile.bechade@limsi.fr Guillaume Dubuisson-Duplessis LIMSI-CNRS, Université Paris-Saclay, Orsay, France e-mail: gdubuisson@limsi.fr Gabrielle Pittaro LIMSI-CNRS, Université Paris-Saclay, Orsay, France e-mail: gabrielle.pittaro@univ-sorbonne.fr Laurence Devillers LIMSI-CNRS, Université Paris-Sorbonne, Orsay, France e-mail: devil@limsi.fr

[1]  Catholijn M. Jonker,et al.  A BDI Dialogue Agent for Social Support: Specification and Evaluation Method , 2012, AAMAS 2012.

[2]  Maria Panou,et al.  ICT services for prolonging independent living of the elderly with cognitive impairments - IN LIFE concept , 2015, AAATE Conf..

[3]  Adriana Tapus,et al.  A model for synthesizing a combined verbal and nonverbal behavior based on personality traits in human-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Adriana Tapus,et al.  The ENRICHME Project: Lessons Learnt from a First Interaction with the Elderly , 2016, ICSR.

[5]  Marie Tahon,et al.  Détection des états affectifs lors d’interactions parlées : robustesse des indices non verbaux [Automatic in-voice affective state detection in spontaneous speech: robustness of non-verbal cues] , 2014, TAL.

[6]  S. Tobis,et al.  Occupational Therapy Students' Perceptions of the Role of Robots in the Care for Older People Living in the Community , 2017, Occupational therapy international.

[7]  Marie Tahon,et al.  Inference of Human Beings’ Emotional States from Speech in Human–Robot Interactions , 2015, Int. J. Soc. Robotics.

[8]  Guangming Xiong,et al.  Development of Assistant Robot with Standing-up Devices for Paraplegic Patients and Elderly People , 2007, 2007 IEEE/ICME International Conference on Complex Medical Engineering.

[9]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[10]  Yunxia Wang,et al.  Research on a detection and recognition method of tactile-slip sensation used to control the Elderly-assistant & Walking-assistant Robot , 2012, 2012 IEEE International Conference on Automation Science and Engineering (CASE).

[11]  S. Kumar,et al.  Handicapped assisting robot , 2013, 2013 International Conference on Current Trends in Engineering and Technology (ICCTET).

[12]  Amir Aly,et al.  Metrics and benchmarks in human-robot interaction: Recent advances in cognitive robotics , 2017, Cognitive Systems Research.