Task-driven moving object detection for robots using visual attention

Detection of task-specific moving objects from a sequence of images obtained by a camera attached to a moving robot is a complex task. This is mainly due to background motion in the video. This paper proposes a probabilistic object-based motion attention model for this purpose. This model is composed of four components: pre-attentive object-based segmentation, bottom-up motion attention, object-based top-down biasing, and contour based object representation. The object-based attentional competition is implemented by combination of bottom-up saliency and top-down bias maps. The probabilistic distribution of attention is obtained by using Bayesian inference so as to allow uncertainties to be present. The proposed method can directly stand out moving objects of interest, thus the necessity of background motion estimation is eliminated. Experimental results in natural scenes have shown to validate this method even in case of occlusion.

[1]  C. J. Downing.  Expectancy and visual-spatial attention: effects on perceptual quality. , 1988, Journal of experimental psychology. Human perception and performance.

[2]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[3]  Eero P. Simoncelli.  Distributed representation and analysis of visual motion , 1993 .

[4]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[5]  H. Barlow.  Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[6]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[7]  Siwei Luo,et al.  A Model of Space and Object-based Attention for Visual Saliency , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[8]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[9]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[10]  Carl R Olson,et al.  Object-based vision and attention in primates , 2001, Current Opinion in Neurobiology.

[11]  Bärbel Mertsching,et al.  Evaluation of Visual Attention Models for Robots , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[12]  J. Duncan.  Selective attention and the organization of visual information , 1984 .

[13]  Sir G. Archaeopteryx.  Object-based attention in the primary visual cortex of the macaque monkey , 1998 .

[14]  Rajesh P. N. Rao,et al.  Probabilistic Models of the Brain: Perception and Neural Function , 2002 .

[15]  Yaoru Sun,et al.  Hierarchical object-based visual attention for machine vision , 2003 .

[16]  D. Surmeier,et al.  Grouping of image fragments in primary visual cortex , 2022 .

[17]  George K. I. Mann,et al.  A Biologically Inspired Bayesian Model of Visual Attention for Humanoid Robots , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[18]  M. Farah,et al.  Does visual attention select objects or locations? , 1994, Journal of experimental psychology. General.

[19]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[20]  J. Duncan.  Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[21]  Bernd Jähne,et al.  Spatio-Temporal Image Processing , 1993, Lecture Notes in Computer Science.

[22]  Eero P. Simoncelliy,et al.  Computing Optical Flow Distributions Using Spatio-temporal Filters , 1996 .

[23]  Naokazu Yokoya,et al.  Real-time tracking of multiple moving objects in moving camera image sequences using robust statistics , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[24]  T. S. Lee,et al.  Dynamics of subjective contour formation in the early visual cortex. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Giulio Sandini,et al.  Object-based Visual Attention: a Model for a Behaving Robot , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[26]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[27]  C. Eriksen,et al.  Visual attention within and around the field of focal attention: A zoom lens model , 1986, Perception & psychophysics.

[28]  M. Farah.  Visual Agnosia: Disorders of Object Recognition and What They Tell Us about Normal Vision , 1990 .

[29]  Ken Nakayama,et al.  Visual attention to surfaces in 3-D space , 1995 .