What topic do you want to hear about? A bilingual talking robot using English and Japanese Wikipedias

We demonstrate a bilingual robot application, WikiTalk, that can talk fluently in both English and Japanese about almost any topic using information from English and Japanese Wikipedias. The English version of the system has been demonstrated previously, but we now present a live demo with a Nao robot that speaks English and Japanese and switches language on request. The robot supports the verbal interaction with face-tracking, nodding and communicative gesturing. One of the key features of the WikiTalk system is that the robot can switch from the current topic to related topics during the interaction in order to navigate around Wikipedia following the user’s individual interests.

[1]  Kristiina Jokinen,et al.  Multilingual WikiTalk: Wikipedia-based talking robots that switch languages , 2015, SIGDIAL Conference.

[2]  Emer Gilmartin,et al.  Multimodal conversational interaction with a humanoid robot , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[3]  Nick Campbell,et al.  Investigating the use of Non-verbal Cues in Human-Robot Interaction with a Nao robot , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[4]  Kristiina Jokinen,et al.  Integration of gestures and speech in human-robot interaction , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[5]  Kristiina Jokinen,et al.  Constructive Interaction for Talking about Interesting Topics , 2012, LREC.

[6]  Kristiina Jokinen,et al.  Open-Domain Information Access with Talking Robots , 2013, SIGDIAL Conference.

[7]  Kristiina Jokinen,et al.  Internationalisation and Localisation of Spoken Dialogue Systems , 2016, IWSDS.

[8]  Mikko Kurimo,et al.  Towards SamiTalk: A Sami-Speaking Robot Linked to Sami Wikipedia , 2016, IWSDS.

[9]  Dimitra Anastasiou,et al.  Evaluation of WikiTalk - User Studies of Human-Robot Interaction , 2013, HCI.

[10]  Kristiina Jokinen,et al.  Open-domain Conversations with Humanoid Robots , 2012, Coling 2012.

[11]  Kristiina Jokinen,et al.  DigiSami and Digital Natives: Interaction Technology for the North Sami Language , 2016, IWSDS.

[12]  Graham Wilcock WikiTalk: A Spoken Wikipedia-based Open-Domain Knowledge Access System , 2012, Coling 2012.