Neuromorphic VLSI Models of Selective Attention: From Single Chip Vision Sensors to Multi-chip Systems

Biological organisms perform complex selective attention operations continuously and effortlessly. These operations allow them to quickly determine the motor actions to take in response to combinations of external stimuli and internal states, and to pay attention to subsets of sensory inputs suppressing non salient ones. Selective attention strategies are extremely effective in both natural and artificial systems which have to cope with large amounts of input data and have limited computational resources. One of the main computational primitives used to perform these selection operations is the Winner-Take-All (WTA) network. These types of networks are formed by arrays of coupled computational nodes that selectively amplify the strongest input signals, and suppress the weaker ones. Neuromorphic circuits are an optimal medium for constructing WTA networks and for implementing efficient hardware models of selective attention systems. In this paper we present an overview of selective attention systems based on neuromorphic WTA circuits ranging from single-chip vision sensors for selecting and tracking the position of salient features, to multi-chip systems implement saliency-map based models of selective attention.

[1]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[2]  Giacomo Indiveri,et al.  A neuromorphic VLSI device for implementing 2D selective attention systems , 2001, IEEE Trans. Neural Networks.

[3]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[4]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[5]  Chiara Bartolozzi,et al.  Selective attention in silicon , 2007 .

[6]  Shumeet Baluja,et al.  Expectation-based selective attention for visual monitoring and control of a robot vehicle , 1997, Robotics Auton. Syst..

[7]  Christof Koch,et al.  Analog VLSI-Based Modeling of the Primate Oculomotor System , 1999, Neural Computation.

[8]  Giacomo Indiveri Smart Adaptive Systems in Silicon , 2004 .

[9]  H. Egeth,et al.  Inhibition of return to object-based and environment-based locations , 1994, Perception & psychophysics.

[10]  Kwabena Boahen,et al.  A silicon retina that reproduces signals in the optic nerve , 2006, Journal of neural engineering.

[11]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[12]  John Wawrzynek,et al.  Silicon Auditory Processors as Computer Peripherals , 1992, NIPS.

[13]  Giacomo Indiveri Behaving LEGOBot with Tracking chip , 2002 .

[14]  Michael C. Mozer,et al.  Computational modeling of spatial attention , 1996 .

[15]  John Lazzaro,et al.  Winner-Take-All Networks of O(N) Complexity , 1988, NIPS.

[16]  T. Delbruck,et al.  A 64x64 aer logarithmic temporal derivative silicon retina , 2005, Research in Microelectronics and Electronics, 2005 PhD.

[17]  Carver A. Mead,et al.  Scanners for visualizing activity of analog VLSI circuitry , 1991 .

[18]  Vittorio Dante,et al.  PCI-AER hardware and software for interfacing to address-event based neuromorphic systems , 2005 .

[19]  Jörg Kramer,et al.  An integrated optical transient sensor , 2002 .

[20]  Stephen P. DeWeerth,et al.  Analog VLSI circuits for stimulus localization and centroid computation , 1992, International Journal of Computer Vision.

[21]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[23]  Giacomo Indiveri,et al.  A Current-Mode Hysteretic Winner-take-all Network, with Excitatory and Inhibitory Coupling , 2001 .

[24]  S. Shimojo,et al.  Location vs Feature: Reaction Time Reveals Dissociation Between Two Visual Functions , 1996, Vision Research.

[25]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[26]  André van Schaik,et al.  AER EAR: A Matched Silicon Cochlea Pair With Address Event Representation Interface , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[27]  Rodney J. Douglas,et al.  Feedback interactions between neuronal pointers and maps for attentional processing , 1999, Nature Neuroscience.

[28]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[29]  Jan Van der Spiegel,et al.  VLSI Model of Primate Visual Smooth Pursuit , 1995, NIPS.

[30]  Ralph Etienne-Cummings Intelligent Robot Vision Sensors in VLSI , 1999, Auton. Robots.

[31]  L. Abbott,et al.  A model of multiplicative neural responses in parietal cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[32]  C. Bockisch,et al.  Where are the things we see? , 1997, Nature.

[33]  Takeo Kanade,et al.  Computational sensor for visual tracking with attention , 1998, IEEE J. Solid State Circuits.

[34]  Orly Yadid-Pecht,et al.  High-speed and high-precision current winner-take-all circuit , 2005, IEEE Transactions on Circuits and Systems II: Express Briefs.

[35]  Tobi Delbrück,et al.  A 128 X 128 120db 30mw asynchronous vision sensor that responds to relative intensity change , 2006, 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers.

[36]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[37]  Timothy K. Horiuchi,et al.  Object-Based Selection Within an Analog VLSI Visual Attention System , 1998 .

[38]  Kwabena Boahen,et al.  Communicating neuronal ensembles between neuromorphic chips , 1998 .

[39]  C. Mead,et al.  Neuromorphic Robot Vision with Mixed Analog- Digital Architecture , 2005 .

[40]  Giacomo Indiveri,et al.  Winner-Take-All Networks with Lateral Excitation , 1997 .

[41]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[42]  Giacomo Indiveri,et al.  An adaptive visual tracking sensor with a hysteretic winner-take-all network , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[43]  G Indiveri,et al.  Neuromorphic Vision Sensors , 2000, Science.

[44]  Carver A. Mead,et al.  Analog VLSI Phototransduction by continuous-time, adaptive, logarithmic photoreceptor circuits , 1995 .

[45]  Pietro Perona,et al.  Selective visual attention enables learning and recognition of multiple objects in cluttered scenes , 2005, Comput. Vis. Image Underst..

[46]  Tobi Delbrück,et al.  A Multichip Pulse-Based Neuromorphic Infrastructure and Its Application to a Model of Orientation Selectivity , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[47]  Giacomo Indiveri,et al.  Object Tracking Using Multiple Neuromorphic Vision Sensors , 2004, RoboCup.

[48]  Shih-Chii Liu,et al.  Silicon Retina with Adaptive Filtering Properties , 1997, NIPS.

[49]  Christof Koch,et al.  Analog VLSI Circuits for Attention-Based, Visual Tracking , 1996, NIPS.

[50]  Tobi Delbrück,et al.  AER Building Blocks for Multi-Layer Multi-Chip Neuromorphic Vision Systems , 2005, NIPS.

[51]  Giacomo Indiveri,et al.  Modeling Selective Attention Using a Neuromorphic Analog VLSI Device , 2000, Neural Computation.

[52]  E. Culurciello,et al.  Arbitrated address event representation digital image sensor , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[53]  Giacomo Indiveri,et al.  Neuromorphic analog VLSI sensor for visual tracking: circuits and application examples , 1999 .

[54]  Giacomo Indiveri,et al.  Robot Soccer using Optical Analog VLSI Sensors , 2004, Int. J. Robotics Autom..

[55]  Shih-Chii Liu,et al.  Analog VLSI: Circuits and Principles , 2002 .

[56]  Marlene Behrmann,et al.  The cognitive neuroscience of visual attention , 1999, Current Opinion in Neurobiology.

[57]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[58]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[59]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.