Evolutionary Robot Vision and Fuzzy Evaluation for Natural Communication of Partner Robots

This paper proposes a method of evolutionary robot vision based on a steady-state genetic algorithm and fuzzy evaluation. In order to improve the communication capability of human-friendly partner robots, the perception of human face should be performed as correctly as possible. First, we discuss the concept of evolutionary robot vision in dynamic environments. Next, we propose growing neural gas for preprocessing as a bottom-up processing, and steady- state genetic algorithm for template matching in human face recognition as a top-down processing. In order to improve the performance of the human face recognition, we use fuzzy evaluation for evaluating the degree of human face. Finally, we show several experimental results and discuss the effectiveness of the proposed method. conversation can activate the brain of such elderly people and can improve their concentration and memory abilities. Nursing care for the elderly people can be expected to keep their health by having conversations with robots. However, it is very difficult to continue the meaningful and attractive conversations with robots. Therefore, such a robot requires adaptive perceptual systems to communicate with a human flexibly, and adaptive action systems to learn human behaviors. To realize the learning through interaction with people, we must consider a total architecture of the cognitive development. The cognitive development for robots has been discussed in the fields such as cognitive robotics and embodied cognitive science (8-10). In the previous research of cognitive robotics, many researchers have proposed the learning methods for the achievement of joint attention, imitative learning, linguistic acquisition from the viewpoints of babies and infants (6,10). On the other hand, we focus on the refinement of associative memory by using symbolic information used for utterances and patterns based on visual information through interaction with people as cognitive development of robots. We proposed the concept of structured learning and discussed the importance of total architecture of the learning mechanism (30). However, we did not discuss the performance of the human detection so much. In the previous works, we proposed a simple method of people tracking based on the combination of skin color and hair color, and we have a problem of misdetection of people by objects with similar color combination in the background image. In this paper, we propose a method for detecting a human face based on evolutionary computation and fuzzy evaluation in order to improve the performance of people tracking. The both of evolutionary computation and fuzzy theory are useful and practical in the search under the environment including noise. We proposed the concept of evolutionary robot vision based on the analogy between visual perception and evolutionary search (32). We apply the concept of evolutionary robot vision and fuzzy evaluation for people tracking. The paper is organized as follow. In the section 2, we explain the concept of evolutionary robot vision. Next, in the section 3 we propose a growing neural gas for color extraction and a steady-state genetic algorithm with fuzzy inference for face recognition. Section 4 shows several experimental results and discuss the effectiveness of the proposed method.

[1]  L. F. Pau,et al.  Handbook of pattern recognition & computer vision , 1993 .

[2]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[3]  Akihiro Yorita,et al.  Visual Tracking of a Partner Robot through Interaction with People , 2008 .

[4]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[5]  Naoyuki Kubota,et al.  Human Head Tracking Based on Particle Swarm Optimization and Genetic Algorithm , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[6]  N. Kubota,et al.  Structured learning for partner robots based on natural communication , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[7]  Georgios C. Anagnostopoulos,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2003, Lecture Notes in Computer Science.

[8]  Justine Cassell,et al.  Embodied Conversational Agents: Representation and Intelligence in User Interfaces , 2001, AI Mag..

[9]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[10]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[11]  Naoyuki Kubota Visual perception and reproduction for imitative learning of a partner robot , 2006 .

[12]  Fumio Kojima,et al.  Multiple fuzzy state-value functions for human evaluation through interactive trajectory planning of a partner robot , 2006, Soft Comput..

[13]  Naoyuki Kubota,et al.  Evolutionary Robot Vision for Multiple Human Heads Tracking of A Partner Robot , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[14]  Tetsuo Ono,et al.  Physical relation and expression: joint attention for human-robot interaction , 2003, IEEE Trans. Ind. Electron..

[15]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[16]  Francisco Herrera,et al.  Real-Coded Memetic Algorithms with Crossover Hill-Climbing , 2004, Evolutionary Computation.

[17]  Kunihiko Fukushima,et al.  Neural network model restoring partly occluded patterns , 2003, Int. J. Knowl. Based Intell. Eng. Syst..

[18]  S-W Lee,et al.  Biologically Motivated Computer Vision , 2000, Lecture Notes in Computer Science.

[19]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[20]  Tomoyuki Hiroyasu,et al.  NCGA: Neighborhood Cultivation Genetic Algorithm for Multi-Objective Optimization Problems , 2002, GECCO Late Breaking Papers.

[21]  Naoyuki Kubota,et al.  Cooperative Perceptual Systems for Partner Robots Based on Sensor Network , 2006 .

[22]  D. Sperber,et al.  Relevance: Communication and Cognition , 1997 .

[23]  Naoyuki Kubota,et al.  Computational intelligence for structured learning of a partner robot based on imitation , 2005, Inf. Sci..

[24]  Yasushi Nakauchi,et al.  A Social Robot that Stands in Line , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[25]  Tomoyuki Hiroyasu,et al.  LCGA: Local Cultivation Genetic Algorithm For Multi-objective Optimization Problems , 2002, GECCO.

[26]  Naoyuki Kubota,et al.  Evolutionary robot vision for human tracking of partner robots in ambient intelligence , 2007, 2007 IEEE Congress on Evolutionary Computation.

[27]  Alex A. Freitas,et al.  Evolutionary Computation , 2002 .

[28]  Gilbert Syswerda,et al.  A Study of Reproduction in Generational and Steady State Genetic Algorithms , 1990, FOGA.

[29]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[30]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[31]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[32]  Michal Burda,et al.  Unsupervised clustering with growing self-organizing neural network -- a comparison with non-neural approach , 2005, DATESO.

[33]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[34]  Seong-Whan Lee,et al.  Biologically Motivated Computer Vision , 2002, Lecture Notes in Computer Science.