Office-mate: Selective attention and incremental object perception

We propose an autonomous robot vision system that is applied to develop an intelligent artificial officemate. In order to operate the proposed system in real environment, it is very important for the officemate to be able to adapt to an environmental changes that may occur in an indoor environment. Novelty detection is one of essential functions for the officemate to detect a situation change. The proposed system can indicate a novel scene and a scene change based on a visual selective attention module. Moreover, it can adaptively acquire new information based on incremental object perception, face recognition, and emotion representation. In order to implement an on-line officemate system, we implement an efficient model by simplification and optimization procedure which can reduce the computation load. Experimental results show that the developed system successfully identifies a change of natural scenes and incrementally learns an arbitral object and a face, and it can also extend its knowledge through interaction with human supervisor.

[1]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[2]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Minho Lee,et al.  Autonomous Incremental Visual Environment Perception Based on Visual Selective Attention , 2007, 2007 International Joint Conference on Neural Networks.

[4]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[5]  Aziz Umit Batur,et al.  Adaptive active appearance models , 2005, IEEE Transactions on Image Processing.

[6]  T. Poggio,et al.  A model of V4 shape selectivity and invariance. , 2007, Journal of neurophysiology.

[7]  Minho Lee,et al.  Self-Motivated Autonomous Robot With A Trainable Selective Attention Model , 2009, Intell. Autom. Soft Comput..

[8]  Shaoning Pang,et al.  Incremental learning for online face recognition , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[9]  Minoru Asada,et al.  Cognitive developmental robotics as a new paradigm for the design of humanoid robots , 2001, Robotics Auton. Syst..

[10]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[11]  Stephen R. Marsland,et al.  A self-organising network that grows when required , 2002, Neural Networks.

[12]  Minho Lee,et al.  Stereo saliency map considering affective factors and selective motion analysis in a dynamic environment , 2008, Neural Networks.

[13]  F. Hara,et al.  Facial interaction between animated 3D face robot and human beings , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[14]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[15]  Minho Lee,et al.  Selective attention-based novelty scene detection in dynamic environments , 2006, Neurocomputing.

[16]  R Held,et al.  The development of eye alignment, convergence, and sensory binocularity in young infants. , 1994, Investigative ophthalmology & visual science.

[17]  Minho Lee,et al.  Biologically motivated vergence control system using human-like selective attention model , 2006, Neurocomputing.

[18]  Minho Lee,et al.  Biologically Motivated Incremental Object Perception Based on Selective Attention , 2007, Int. J. Pattern Recognit. Artif. Intell..

[19]  James L. McClelland,et al.  Autonomous Mental Development by Robots and Animals , 2001, Science.

[20]  Minho Lee,et al.  Saliency map model with adaptive masking based on independent component analysis , 2002, Neurocomputing.