Conversation System Based on Computational Intelligence for Robot Partner Using Smart Phone

This paper proposes a conversation system based on multimodal perception for verbal communication between a human and a robot partner using various types of sensors. First, we describe the control structure of the robot partner and explain the architecture of the robot system. Next, evolutionary robot vision is applied to human and object detection. Next, a conversation system based on information ally structured space is proposed. Furthermore, we propose a method of conversation learning based on the flow of human utterance patterns and its related perceptual information. Finally, we show experimental results of the proposed method, and discuss the future direction on this research.

[1]  Naoyuki Kubota,et al.  Information support system based on sensor networks , 2010, 2010 World Automation Congress.

[2]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[3]  Takenori Obo,et al.  Localization of human based on fuzzy spiking neural network in informationally structured space , 2010, International Conference on Fuzzy Systems.

[4]  Cory D. Kidd,et al.  HUMANOID ROBOTS AS COOPERATIVE PARTNERS FOR PEOPLE , 2004 .

[5]  Wulfram Gerstner,et al.  Spiking neurons , 1999 .

[6]  D. Sperber,et al.  Relevance: Communication and Cognition , 1989 .

[7]  Naoyuki Kubota Cognitive Development of Partner Robots Based on Interaction with People , 2008 .

[8]  N. Kubota,et al.  Structured learning for partner robots based on natural communication , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[9]  Takenori Obo,et al.  Localization of human in informationally structured space based on sensor networks , 2010, International Conference on Fuzzy Systems.

[10]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[11]  Naoyuki Kubota,et al.  Computational intelligence for structured learning of a partner robot based on imitation , 2005, Inf. Sci..

[12]  Cory D. Kidd,et al.  An Interactive Robot in a Nursing Home: Preliminary Remarks , 2005 .

[13]  Ben J. A. Krse,et al.  Studying the acceptance of a robotic agent by elderly users , 2006 .

[14]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[15]  Naoyuki Kubota,et al.  Recognition of Indoor Environment by Robot Partner Using Conversation , 2013, J. Adv. Comput. Intell. Intell. Informatics.