An autonomous visual perception model for robots using object-based attention mechanism

The object-based attention theory has shown that perception processes only select one object of interest from the world at a time which is then represented for action. This paper therefore presents an autonomous visual perception model for robots by simulating the object-based bottom-up attention mechanism. Using this model visual perception of robots starts from attentional selection over the scene followed by high-level analysis only on the attended object. The proposed model involves three components: pre-attentive segmentation, bottom-up attentional selection and post-attentive recognition and learning of the attended object. The model pre-attentively segments the visual field into discrete proto-objects at first. Automatic bottom-up competition is then performed to yield a location-based saliency map. By combination of location-based salience within each proto-object, the proto-object based salience is evaluated. The most salient proto-object is selected for recognition and learning. This model has been applied into the robotic task of automatical detection of objects. Experimental results in natural and cluttered scenes are shown to validate this model.

[1]  Barry D. Vaughan,et al.  Object-Based Visual Selection: Evidence From Perceptual Completion , 1998 .

[2]  Giulio Sandini,et al.  Object-based Visual Attention: a Model for a Behaving Robot , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Sir G. Archaeopteryx Object-based attention in the primary visual cortex of the macaque monkey , 1998 .

[4]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[5]  George K. I. Mann,et al.  An object-based visual attention model for robots , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  J. Duncan,et al.  Competitive brain activity in visual attention , 1997, Current Opinion in Neurobiology.

[7]  Azriel Rosenfeld,et al.  Hierarchical Image Analysis Using Irregular Tessellations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[9]  Bärbel Mertsching,et al.  Evaluation of Visual Attention Models for Robots , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[10]  W. Singer,et al.  In search of common foundations for cortical computation , 1997, Behavioral and Brain Sciences.

[11]  Robert B. Fisher,et al.  Object-based visual attention for computer vision , 2003, Artif. Intell..

[12]  Ronen Basri,et al.  Fast multiscale image segmentation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[14]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[15]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[16]  Jean-Michel Jolion Stochastic pyramid revisited , 2003, Pattern Recognit. Lett..