Human-centric point of view for a robot partner: A cooperative project between France and Japan

Robot partners are very useful to help elderly and disabled people keep mental health. This paper explains how a robot partner with a human-centric point of view has been designed and built through a cooperation between the Graduate School of System Design of the Tokyo Metropolitan University, Japan, and the LISTIC of Polytech Annecy Chambery, France. First, we describe the physical design of the robot partner. Next, we present the software part of the robot partner, divided into the offline speech recognition and the knowledge base. Then we show experimental results of the speech recognition. Finally, we discuss the future direction of this project.

[1]  Ben J. A. Kröse,et al.  Enjoyment, intention to use and actual use of a conversational robot by elderly people , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Timothy W. Bickmore,et al.  Designing Relational Agents as Long Term Social Companions for Older Adults , 2012, IVA.

[3]  Glenda Cook,et al.  Emotional Robots: Principles and Experiences with Paro in Denmark, Germany, and the UK , 2013 .

[4]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[5]  D. Sperber,et al.  Relevance: Communication and Cognition , 1989 .

[6]  F. Béchet.  LIA―PHON: Un système complet de phonétisation de textes , 2001 .

[7]  Maja J. Mataric,et al.  Using Socially Assistive Human–Robot Interaction to Motivate Physical Exercise for Older Adults , 2012, Proceedings of the IEEE.

[8]  Yan Zhang,et al.  Philos: a sociable robot for human robot interactions and wireless health monitoring , 2012, SAC '12.

[9]  Takenori Obo,et al.  Exercise support system with robot partner based on feeling of self-efficacy , 2014, 2014 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[10]  Mauro Cettolo,et al.  IRSTLM: an open source toolkit for handling large scale language models , 2008, INTERSPEECH.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Takanori Shibata,et al.  Effects of robot-assisted activity for elderly people and nurses at a day service center , 2004, Proceedings of the IEEE.

[13]  Naoyuki Kubota,et al.  Gestural and facial communication with smart phone based robot partner using emotional model , 2014, 2014 World Automation Congress (WAC).

[14]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[15]  Naoyuki Kubota,et al.  Conversation system for natural communication with robot partner , 2014, 2014 10th France-Japan/ 8th Europe-Asia Congress on Mecatronics (MECATRONICS2014- Tokyo).

[16]  Hideyuki Sawada,et al.  Identification and tracking of particular speaker in noisy environment , 2004, SPIE Optics East.

[17]  Naoyuki Kubota,et al.  Facial and gestural expression generation for robot partners , 2014, 2014 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[18]  Brian Scassellati,et al.  Socially assistive robotics [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[19]  B. MacDonald,et al.  The psychosocial effects of a companion robot: a randomized controlled trial. , 2013, Journal of the American Medical Directors Association.