A 100-m Range 10-Frame/s 340 $\,\times\, $96-Pixel Time-of-Flight Depth Sensor in 0.18-$\mu\hbox{m}$ CMOS

This paper introduces a single-photon detection technique for time-of-flight distance ranging based on the temporal and spatial correlation of photons. A proof-of-concept prototype achieving depth imaging up to 100 meters with a resolution of 340 × 96 pixels at 10 frames/s was implemented. At the core of the system, a sensor chip comprising 32 macro-pixels based on an array of single-photon avalanche diodes featuring an optical fill factor of 70% was fabricated in a 0.18-μm CMOS. The chip also comprises an array of 32 circuits capable of generating precise triggers upon correlation events as well as of sampling the number of photons involved in each correlation event, and an array of 32 12-b time-to-digital converters. Characterization of the TDC array led to -0.52 LSB and 0.73 LSB of differential and integral nonlinearities, respectively. Quantitative evaluation of the TOF sensor under strong solar background light, i.e., 80 klux, revealed a repeatability error better than 10 cm throughout the distance range of 100 m, thus leading to a relative precision of 0.1%. In the same condition, the relative nonlinearity error was 0.37%. In order to show the suitability of our approach in a real-world situation, experimental results in which the depth sensor was operated in a typical traffic scenario are also reported.

[1]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[2]  Peter Seitz,et al.  Robust Optical Time-of-Flight Range Imaging Based on Smart Pixel Structures , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  M. Kuijk,et al.  A 1k-pixel 3D CMOS sensor , 2008, 2008 IEEE Sensors.

[4]  Cristiano Niclass,et al.  A 100m-range 10-frame/s 340×96-pixel time-of-flight depth sensor in 0.18μm CMOS , 2011, 2011 Proceedings of the ESSCIRC (ESSCIRC).

[5]  J. Massa,et al.  Optical design and evaluation of a three-dimensional imaging and ranging system based on time-correlated single-photon counting. , 2002, Applied optics.

[6]  Michael J. Cree,et al.  Video-rate or high-precision: a flexible range imaging camera , 2008, Electronic Imaging.

[7]  L. Gonzo,et al.  A Range Image Sensor Based on 10- $\mu{\hbox {m}}$ Lock-In Pixels in 0.18-$\mu$m CMOS Imaging Technology , 2011, IEEE Journal of Solid-State Circuits.

[8]  Cristiano Niclass,et al.  A 0.18μm CMOS single-photon sensor for coaxial laser rangefinders , 2010, 2010 IEEE Asian Solid-State Circuits Conference.

[9]  D. O'connor,et al.  Time-Correlated Single Photon Counting , 1984 .

[10]  Chang-Yeong Kim,et al.  A 1920×1080 3.65μm-pixel 2D/3D image sensor with split and binning pixel structure in 0.11pm standard CMOS , 2012, 2012 IEEE International Solid-State Circuits Conference.

[11]  Brent Schwarz,et al.  LIDAR: Mapping the world in 3D , 2010 .

[12]  C. Niclass,et al.  A miniature actively recharged single-photon detector free of afterpulsing effects with 6ns dead time in a 0.18µm CMOS technology , 2010, 2010 International Electron Devices Meeting.

[13]  M. Gersbach,et al.  A 128 $\times$ 128 Single-Photon Image Sensor With Column-Level 10-Bit Time-to-Digital Converter Array , 2008, IEEE Journal of Solid-State Circuits.

[14]  P.-A. Besse,et al.  Design and characterization of a CMOS 3-D image sensor based on single photon avalanche diodes , 2005, IEEE Journal of Solid-State Circuits.

[15]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[16]  Edoardo Charbon,et al.  A 128x128 Single-Photon Imager with on-Chip Column-Level 97ps 10bit Time-to-Digital-Converter Array , 2008, ISSCC 2008.

[17]  S. Tisa,et al.  3D ranging with a high speed imaging array , 2010, 6th Conference on Ph.D. Research in Microelectronics & Electronics.

[18]  Dr.-Ing. Thorsten Ringbeck A 3 D TIME OF FLIGHT CAMERA FOR OBJECT DETECTION , 2007 .

[19]  A. Lacaita,et al.  Avalanche photodiodes and quenching circuits for single-photon detection. , 1996, Applied optics.

[20]  B.J. Hosticka,et al.  A 64×8 Pixel 3-D CMOS Time Of Flight Image Sensor for Car Safety Applications , 2006, 2006 Proceedings of the 32nd European Solid-State Circuits Conference.

[21]  Takashi Naito,et al.  Pedestrian recognition using high-definition LIDAR , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[22]  T. Oggier,et al.  SwissRanger SR 3000 and First Experiences based on Miniaturized 3 D-TOF Cameras , 1968 .

[23]  M. Gersbach,et al.  Characterization of large-scale non-uniformities in a 20k TDC/SPAD array integrated in a 130nm CMOS process , 2011, 2011 Proceedings of the European Solid-State Device Research Conference (ESSDERC).

[24]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[25]  R. Collins,et al.  Long-range time-of-flight scanning sensor based on high-speed time-correlated single-photon counting. , 2009, Applied optics.

[26]  S. Cova,et al.  Towards picosecond resolution with single-photon avalanche diodes , 1981 .

[27]  Horst Zimmermann,et al.  A 16$\, \times $16 Pixel Distance Sensor With In-Pixel Circuitry That Tolerates 150 klx of Ambient Light , 2010, IEEE Journal of Solid-State Circuits.

[28]  E. Charbon,et al.  Single-Photon Synchronous Detection , 2009, IEEE Journal of Solid-State Circuits.

[29]  G. Yahav,et al.  3D Imaging Camera for Gaming Application , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[30]  Hyung Kyu Lim The 2nd Wave of the Digital Consumer Revolution: Challenges and Opportunities! , 2008, 2008 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[31]  Robert K. Henderson,et al.  A 128×96 pixel event-driven phase-domain ΔΣ-based fully digital 3D camera in 0.13μm CMOS imaging technology , 2011, 2011 IEEE International Solid-State Circuits Conference.