APES: Attentively Perceiving Robot

Robot vision systems—inspired by human-like vision—are required to employ mechanisms similar to those that have proven to be crucial in human visual performance. One of these mechanisms is attentive perception. Findings from vision science research suggest that attentive perception requires a multitude of properties: A retina with fovea-periphery distinction, an attention mechanism that can be manipulated both mechanically and internally, an extensive set of visual primitives that enable different representation modes, an integration mechanism that can infer the appropriate visual information in spite of eye, head, body and target motion, and finally memory for guiding eye movements and modeling the environment. In this paper we present an attentively “perceiving” robot called APES. The novelty of this system stems from the fact that it incorporates all of these properties simultaneously. As is explained, original approaches have to be taken to realize each of the properties so that they can be integrated together in an attentive perception framework.

[1]  H. Isil Bozma,et al.  A new memory model for selective perception systems , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[2]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[3]  James J. Clark Spatial attention and latencies of saccadic eye movements , 1999, Vision Research.

[4]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[5]  Yiannis Aloimonos,et al.  Purposive and qualitative active vision , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[6]  Promising Directions in Active VisionWritten by the attendees of the NSF Active Vision , 2007 .

[7]  David Kortenkamp,et al.  A behavior-based approach to active stereo vision for mobile robots , 1998 .

[8]  Wai-Kiang Yeap,et al.  Computing a Representation of the Local Environment , 1999, Artif. Intell..

[9]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[10]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[11]  Keizo Shinomori,et al.  PII: S0042-6989(97)00460-4 , 1998 .

[12]  D. C. Essen,et al.  Neural responses to polar, hyperbolic, and Cartesian gratings in area V4 of the macaque monkey. , 1996, Journal of neurophysiology.

[13]  Nikolaos Papanikolopoulos Controlled active vision , 1992 .

[14]  David Kortenkamp,et al.  Prototypes, Location, and Associative Networks (PLAN): Towards a Unified Theory of Cognitive Mapping , 1995, Cogn. Sci..

[15]  H. Greene Temporal relationships between eye fixations and manual reactions in visual search. , 1999, Acta psychologica.

[16]  D. Mitchell Wilkes,et al.  Knowledge-sharing techniques for Egocentric Navigation , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[17]  Rajesh P. N. Rao,et al.  Modeling Saccadic Targeting in Visual Search , 1995, NIPS.

[18]  P. Viviani Eye movements in visual search: cognitive, perceptual and motor control aspects. , 1990, Reviews of oculomotor research.

[19]  Fernando J. Corbacho,et al.  A biologically inspired visual system for an autonomous robot , 2001, Neurocomputing.

[20]  David Kortenkamp,et al.  Integrating active perception with an autonomous robot architecture , 1999, Robotics Auton. Syst..

[21]  Christopher M. Brown,et al.  Control of selective perception using bayes nets and decision theory , 1994, International Journal of Computer Vision.

[22]  B. Julesz Dialogues on Perception , 1994 .

[23]  Ronald Lumia,et al.  TRICLOPS: A tool for studying active vision , 2005, International Journal of Computer Vision.

[24]  Seiji Inokuchi,et al.  Retina-like visual sensor for fast tracking and navigation robots , 1997, Machine Vision and Applications.

[25]  Carl-Fredrik Westin,et al.  Attention control for robot vision , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  D. Hubel Eye, brain, and vision , 1988 .

[27]  Dana H. Ballard,et al.  Principles of animate vision , 1992, CVGIP Image Underst..

[28]  C. Soyer,et al.  Further experiments in classification of attentional sequences: combining instantaneous and temporal evidence , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[29]  G Westheimer,et al.  The oculomotor system. , 1978, Science.

[30]  K. Kawamura,et al.  The Sensory Ego-Sphere as a Short-Term Memory for Humanoids , 2002 .

[31]  Carolina M. Zingale,et al.  Planning sequences of saccades , 1987, Vision Research.

[32]  Hemant D. Tagare,et al.  A Maximum-Likelihood Strategy for Directing Attention during Visual Search , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  G. Legge,et al.  The importance of eye movements in the analysis of simple patterns , 1986, Vision Research.

[34]  Giulio Sandini,et al.  A space-variant approach to oculomotor control , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[35]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[36]  Wai-Kiang Yeap Towards a Computational Theory of Cognitive Maps , 1988, Artif. Intell..

[37]  Christopher M. Brown,et al.  Selective Attention as Sequential Behavior: Modeling Eye Movements with an Augmented Hidden Markov Model , 1990 .

[38]  H. Isil Bozma,et al.  Shape Identification Using Probabilistic Models of Attentional Sequences , 1994, MVA.

[39]  O. Mimura [Eye movements]. , 1992, Nippon Ganka Gakkai zasshi.

[40]  H. Isil Bozma,et al.  Attentional sequence-based recognition: Markovian and evidential reasoning , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[41]  Madan G. Singh,et al.  Fuzzy analytic network process and its application to the development of decision support systems , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[42]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[43]  Robert J. Wood,et al.  Towards a 3g crawling robot through the integration of microrobot technologies , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[44]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[45]  I. Rybak,et al.  A model of attention-guided visual perception and recognition , 1998, Vision Research.

[46]  S. Zeki The visual image in mind and brain. , 1992, Scientific American.

[47]  James S. Albus,et al.  Outline for a theory of intelligence , 1991, IEEE Trans. Syst. Man Cybern..