An all-solid-state optical range camera for 3 D real-time imaging with sub-centimeter depth resolution ( SwissRangerTM )

A new miniaturized camera system that is capable of 3-dimensional imaging in real-time is presented. The compact imaging device is able to entirely capture its environment in all three spatial dimensions. It reliably and simultaneously delivers intensity data as well as range information on the objects and persons in the scene. The depth measurement is based on the time-of-flight (TOF) principle. A custom solid-state image sensor allows the parallel measurement of the phase, offset and amplitude of a radio frequency (RF) modulated light field that is emitted by the system and reflected back by the camera surroundings without requiring any mechanical scanning parts. In this paper, the theoretical background of the implemented TOF principle is presented, together with the technological requirements and detailed practical implementation issues of such a distance measuring system. Furthermore, the schematic overview of the complete 3D-camera system is provided. The experimental test results are presented and discussed. The present camera system can achieve sub-centimeter depth resolution for a wide range of operating conditions. A miniaturized version of such a 3D-solid-state camera, the SwissRanger 2, is presented as an example, illustrating the possibility of manufacturing compact, robust and cost effective ranging camera products for 3D imaging in real-time.

[1]  G. E. Smith,et al.  Charge coupled semiconductor devices , 1970, Bell Syst. Tech. J..

[2]  W. Kosonocky,et al.  Free charge transfer in charge-coupled devices , 1972 .

[3]  H. Grubin.  The physics of semiconductor devices , 1979, IEEE Journal of Quantum Electronics.

[4]  S. M. Sze.  Physics of semiconductor devices /2nd edition/ , 1981 .

[5]  K. Creath.  V Phase-Measurement Interferometry Techniques , 1988 .

[6]  Edmund K. Banghart,et al.  A model for charge transfer in buried-channel charge-coupled devices at low temperature , 1991 .

[7]  J.G.C. Bakker,et al.  Simple analytical expressions for the fringing field and fringing-field-induced transfer time in charge-coupled devices , 1991 .

[8]  Eric R. Fossum,et al.  Active pixel sensors: are CCDs dinosaurs? , 1993, Electronic Imaging.

[9]  Peter Seitz,et al.  The lock-in CCD-two-dimensional synchronous detection of light , 1995 .

[10]  A. Theuwissen,et al.  Solid-State Imaging with Charge-Coupled Devices , 1995 .

[11]  Peter Seitz,et al.  The multitap lock-in CCD with offset subtraction , 1997 .

[12]  Thomas Spirig,et al.  Smart CCD/CMOS based image sensors with programmable, real-time, temporal and spatial convolution capabilities for applications in machine vision and optical metrology , 1997 .

[13]  Alice Biber,et al.  Demodulation pixels in CCD and CMOS technologies for time-of-flight ranging , 2000, Electronic Imaging.

[14]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .