> Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1

This paper describes a 128 128 pixel CMOS vision sensor. Each pixel independently and in continuous time quantizes local relative intensity changes to generate spike events. These events appear at the output of the sensor as an asynchronous stream of digital pixel addresses. These address-events signify scene reflectance change and have sub-millisecond timing precision. The output data rate depends on the dynamic content of the scene and is typically orders of magnitude lower than those of conventional frame-based imagers. By combining an active continuous-time front-end logarithmic photoreceptor with a self-timed switched-capacitor differencing circuit, the sensor achieves an array mismatch of 2.1% in relative intensity event threshold and a pixel bandwidth of 3 kHz under 1 klux scene illumination. Dynamic range is 120 dB and chip power consumption is 23 mW. Event latency shows weak light dependency with a minimum of 15 s at 1 klux pixel illumination. The sensor is built in a 0.35 m 4M2P process. It has 40 40 m pixels with 9.4% fill factor. By providing high pixel bandwidth, wide dynamic range, and precisely timed sparse digital output, this silicon retina provides an attractive combination of characteristics for low-latency dynamic vision under uncontrolled illumination with low post-processing requirements.

[1]  Misha A. Mahowald,et al.  An Analog VLSI System for Stereoscopic Vision , 1994 .

[2]  Carver A. Mead,et al.  Analog VLSI adaptive logarithmic wide-dynamic-range photoreceptor , 1994 .

[3]  S. Kavadias,et al.  A logarithmic response CMOS image sensor with on-chip calibration , 2000, IEEE Journal of Solid-State Circuits.

[4]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[5]  Xinqiao Liu,et al.  A 10000 frames/s CMOS digital pixel sensor , 2001, IEEE J. Solid State Circuits.

[6]  J. Schemmel,et al.  A self-calibrating single-chip CMOS camera with logarithmic response , 2001, IEEE J. Solid State Circuits.

[7]  Jörg Kramer,et al.  An on/off transient imager with event-driven, asynchronous read-out , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[8]  F. Heitger,et al.  A 100×100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding , 2002, IEEE J. Solid State Circuits.

[9]  John G. Harris,et al.  A time-to-first spike CMOS imager , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[10]  Tobi Delbrück,et al.  Self-biasing low power adaptive photoreceptor , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[11]  John G. Harris,et al.  A time-based CMOS image sensor , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[12]  Eugenio Culurciello,et al.  Second generation of high dynamic range, arbitrated digital imager , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[13]  Kwabena Boahen,et al.  Optic nerve signals in a neuromorphic chip II: testing and results , 2004, IEEE Transactions on Biomedical Engineering.

[14]  Tobi Delbrück,et al.  Improved ON/OFF temporally differentiating address-event imager , 2004, Proceedings of the 2004 11th IEEE International Conference on Electronics, Circuits and Systems, 2004. ICECS 2004..

[15]  Kwabena Boahen,et al.  A burst-mode word-serial address-event link-I: transmitter design , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[16]  Eric Grenet,et al.  High dynamic range vision sensor for automotive applications , 2005, European Workshop on Photonics in the Automobile.

[17]  T. Delbruck,et al.  A 64x64 aer logarithmic temporal derivative silicon retina , 2005, Research in Microelectronics and Electronics, 2005 PhD.

[18]  Tobi Delbrück,et al.  AER Building Blocks for Multi-Layer Multi-Chip Neuromorphic Vision Systems , 2005, NIPS.

[19]  Mehdi Azadmehr,et al.  A foveated AER imager chip [address event representation] , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[20]  K. Boahen.  Neuromorphic Microchips. , 2005, Scientific American.

[21]  Mehdi Azadmehr.  A foveated aer imager chip , 2005 .

[22]  R. Etienne-Cummings,et al.  Temporal change threshold detection imager , 2005, ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005..

[23]  Eugenio Culurciello,et al.  CMOS image sensors for sensor networks , 2006 .

[24]  Heinrich Garn,et al.  Estimation of Vehicle Speed Based on Asynchronous Data from a Silicon Retina Optical Sensor , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[25]  Tobi Delbrück,et al.  Fully programmable bias current generator with 24 bit resolution per bias , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[26]  Tobi Delbrück,et al.  A 128 X 128 120db 30mw asynchronous vision sensor that responds to relative intensity change , 2006, 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers.

[27]  A.N. Belbachir,et al.  Embedded Vision System for Real-Time Object Tracking using an Asynchronous Transient Vision Sensor , 2006, 2006 IEEE 12th Digital Signal Processing Workshop & 4th IEEE Signal Processing Education Workshop.

[28]  Martin Litzenberger,et al.  A Dual-Line Optical Transient Sensor with On-Chip Precision Time-Stamp Generation , 2007, 2007 IEEE International Solid-State Circuits Conference. Digest of Technical Papers.

[29]  Tobi Delbrück,et al.  Fast sensory motor control based on event-based hybrid neuromorphic-procedural system , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[30]  Bernabé Linares-Barranco,et al.  A Spatial Contrast Retina With On-Chip Calibration for Neuromorphic Spike-Based AER Vision Systems , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.