Computational sensor for visual tracking with attention

This paper presents a VLSI embodiment of an optical tracking computational sensor which focuses attention on a salient target in its field of view. Using both low-latency massive parallel processing and top-down sensory adaptation, the sensor suppresses interference front features irrelevant for the task at hand, and tracks a target of interest at speeds of up to 7000 pixels/s. The sensor locks onto the target to continuously provide control for the execution of a perceptually guided activity. The sensor prototype, a 24/spl times/24 array of cells, is built in 2-/spl mu/m CMOS technology. Each cell occupies 62 /spl mu/m/spl times/62 /spl mu/m of silicon, and contains a photodetector and processing electronics.

[1]  T. G. Morris,et al.  Analog VLSI circuits for covert attentional shifts , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[2]  John Lazzaro,et al.  Winner-Take-All Networks of O(N) Complexity , 1988, NIPS.

[3]  Vladimir Brajovic,et al.  Computational Sensors for Global Operations in Vision , 1996 .

[4]  Takeo Kanade,et al.  Sensory Attention: Computational Sensor Paradigm for Low-Latency Adaptive Vision , 1997 .

[5]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[6]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[7]  Andreas G. Andreou,et al.  Current-mode subthreshold MOS circuits for analog VLSI neural systems , 1991, IEEE Trans. Neural Networks.

[8]  Luís Alfredo V. de Carvalho,et al.  A Neural Model for the Visual Attention Phenomena , 1995, SBIA.

[9]  Takeo Kanade,et al.  A sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[10]  Christof Koch,et al.  Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits , 1994 .

[11]  Takeo Kanade,et al.  A VLSI sorting image sensor: global massively parallel intensity-to-time processing for low-latency adaptive vision , 1999, IEEE Trans. Robotics Autom..

[12]  Christof Koch,et al.  Analog VLSI Circuits for Attention-Based, Visual Tracking , 1996, NIPS.