A 3-D Camera With Adaptable Background Light Suppression Using Pixel-Binning and Super-Resolution

This paper presents a CMOS time-of-flight (TOF) 3-D camera employing a column-level background light (BGL) suppression scheme for high-resolution outdoor imaging. The use of the column-level approach minimizes a pixel size for high-density pixel arrays. Pixel-binning and super-resolution can be adaptably applied for an optimal BGL suppression at given spatiotemporal resolutions. A prototype sensor has been fabricated by using 0.11 μm CMOS processes. The sensor achieved a fill factor of 24% in a pixel pitch of 5.9 μm which is the smallest among all the reported TOF cameras up to date. Measurement results showed the temporal noise of 1.47 cm-rms with a 100 ms integration time at a demodulation frequency of 12.5 MHz using a white target at 1 m distance. The non-linearity was measured as 1% over the range of 0.75 m ~ 4 m. The BGL suppression over 100 klx was achieved from indoor and outdoor experiments, while the BGL-induced offset was maintained less than 2.6 cm under 0 ~ 100 klx.

[1]  M. Ikeda,et al.  A 375 /spl times/ 365 high-speed 3-D range-finding image sensor using row-parallel search architecture and multisampling technique , 2005, IEEE Journal of Solid-State Circuits.

[2]  Michael Richter,et al.  Novel pixel architecture with inherent background suppression for 3D time-of-flight imaging , 2005 .

[3]  Matteo Perenzoni,et al.  A 160$\times$ 120-Pixels Range Camera With In-Pixel Correlated Double Sampling and Fixed-Pattern Noise Correction , 2011, IEEE Journal of Solid-State Circuits.

[4]  Y. Oike,et al.  Design and implementation of real-time 3-D image sensor with 640 /spl times/ 480 pixel resolution , 2004, IEEE Journal of Solid-State Circuits.

[5]  E. Yoon,et al.  A 5.9µm-pixel 2D/3D image sensor with background suppression over 100klx , 2013, 2013 Symposium on VLSI Circuits.

[6]  T. Ringbeck,et al.  © Author(s) 2007. This work is licensed under a Creative Commons License. Multidimensional measurement by using 3-D PMD sensors , 2022 .

[7]  Horst Zimmermann,et al.  A 2×32 range-finding sensor array with pixel-inherent suppression of ambient light up to 120klx , 2009, 2009 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[8]  James D. K. Kim,et al.  A 3D image sensor with adaptable charge subtraction scheme for background light suppression , 2013, Electronic Imaging.

[9]  Luc Van Gool,et al.  Combining RGB and ToF cameras for real-time 3D hand gesture interaction , 2011, WACV.

[10]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[11]  Matteo Perenzoni,et al.  An 80×60 range image sensor based on 10µm 50MHz lock-in pixels in 0.18µm CMOS , 2010, 2010 IEEE International Solid-State Circuits Conference - (ISSCC).

[12]  Sebastian Thrun,et al.  LidarBoost: Depth superresolution for ToF 3D shape scanning , 2009, CVPR.

[13]  Narendra Ahuja,et al.  A Refractive Camera for Acquiring Stereo and Super-resolution Images , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Jaehyuk Choi,et al.  A Spatial-Temporal Multiresolution CMOS Image Sensor With Adaptive Frame Rates for Tracking the Moving Objects in Region-of-Interest and Suppressing Motion Blur , 2007, IEEE Journal of Solid-State Circuits.

[15]  Horst Zimmermann,et al.  Range finding sensor in 90nm CMOS with bridge correlator based background light suppression , 2010, 2010 Proceedings of ESSCIRC.

[16]  François Blais.  Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[17]  Horst Zimmermann,et al.  A 16$\, \times $16 Pixel Distance Sensor With In-Pixel Circuitry That Tolerates 150 klx of Ambient Light , 2010, IEEE Journal of Solid-State Circuits.

[18]  A.H. Izhal,et al.  A CMOS time-of-flight range image sensor with gates on field oxide structure , 2005, IEEE Sensors, 2005..

[19]  Chang-Yeong Kim,et al.  A 1920×1080 3.65μm-pixel 2D/3D image sensor with split and binning pixel structure in 0.11pm standard CMOS , 2012, 2012 IEEE International Solid-State Circuits Conference.

[20]  Edoardo Charbon,et al.  A 128x128 Single-Photon Imager with on-Chip Column-Level 97ps 10bit Time-to-Digital-Converter Array , 2008, ISSCC 2008.

[21]  Peter Seitz,et al.  Robust Optical Time-of-Flight Range Imaging Based on Smart Pixel Structures , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[22]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[23]  Behzad Razavi,et al.  Design techniques for high-speed, high-resolution comparators , 1992 .

[24]  Seong-Jin Kim,et al.  A CMOS Image Sensor Based on Unified Pixel Architecture With Time-Division Multiplexing Scheme for Color and Depth Image Acquisition , 2012, IEEE Journal of Solid-State Circuits.

[25]  K. Asada,et al.  A 120/spl times/110 position sensor with the capability of sensitive and selective light detection in wide dynamic range for robust active range finding , 2004, IEEE Journal of Solid-State Circuits.

[26]  C. Niclass,et al.  A 100-m Range 10-Frame/s 340 $\,\times\, $96-Pixel Time-of-Flight Depth Sensor in 0.18-$\mu\hbox{m}$ CMOS , 2013, IEEE Journal of Solid-State Circuits.

[27]  Matteo Perenzoni,et al.  Figures of Merit for Indirect Time-of-Flight 3D Cameras: Definition and Experimental Evaluation , 2011, Remote. Sens..

[28]  Sebastian Thrun,et al.  Real time motion capture using a single time-of-flight camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  E. Fossum,et al.  Compact Ambient Light Cancellation Design and Optimization for 3 D Time-of-Flight Image Sensors , 2013 .

[30]  Keisuke Tanaka,et al.  A 3D vision 2.1Mpixel image sensor for single-lens camera systems , 2013, 2013 IEEE International Solid-State Circuits Conference Digest of Technical Papers.

[31]  P.-A. Besse,et al.  Design and characterization of a CMOS 3-D image sensor based on single photon avalanche diodes , 2005, IEEE Journal of Solid-State Circuits.

[32]  Shree K. Nayar,et al.  Video super-resolution using controlled subpixel detector shifts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.