Color Based Saccades for Attention Control

This paper addresses a simplified version of attention control - where a robot is asked to attend to scene points with a priori specified color. Differing from the classical approaches, in which generating fixations is based on explicit search, we introduce the requirement that the search strategy must be accompanied by a series of saccades whose nature control the fixation process. The robot must start from an arbitrary initial fixation point, start looking through the scene and find the target color points as it is doing so. In the explicit search approach, first, the scene point whose color is most similar to the ”looked-for” color is determined and then the camera is made to move to that point. In the artificial potential functions approach, the two stages are merged together where the camera simply starts moving towards a point whose color is similar to the target color – although not necessarily the most similar. We present working implementations of the two approaches – reporting actual experiments with an attentive robot and comparing the resulting search behaviors using quantitative measures on saccadic selectivity and optimization.

[1]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[2]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[3]  B. C. Motter,et al.  The zone of focal attention during active visual search , 1998, Vision Research.

[4]  Iain D Gilchrist,et al.  Refixation frequency and memory mechanisms in visual search , 2000, Current Biology.

[5]  Eileen Kowler,et al.  Eye movements during visual search: the costs of choosing the optimal path , 2001, Vision Research.

[6]  Guang-Zhong Yang,et al.  Visual search: psychophysical models, practical applications , 2002, Image Vis. Comput..

[7]  Eytan Ruppin,et al.  Global vs. local processing of compressed representations: A computational model of visual search , 2000, Neurocomputing.

[8]  U. Neisser VISUAL SEARCH. , 1964, Scientific American.

[9]  Eyal M. Reingold,et al.  The Area Activation Model of Saccadic Selectivity in Visual Search , 2000 .

[10]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[11]  Kang Chen,et al.  Visual Attention and Eye Movements , 2008 .

[12]  B. Deniz Saccades and Fixating Using Artificial Potential Functions , 2006 .

[13]  Yun Xu,et al.  Mapping the Color Space of Saccadic Selectivity in Visual Search , 2007, Cogn. Sci..

[14]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  H. Isil Bozma,et al.  A new memory model for selective perception systems , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[16]  H. Isil Bozma,et al.  Attentional sequence-based recognition: Markovian and evidential reasoning , 2003, IEEE Trans. Syst. Man Cybern. Part B.