Pseudonoise Optical Modulation for Real-Time 3-D Imaging With Minimum Interference

In optical time-of-flight (TOF) range imaging, harmonic intensity modulation of the illumination source is very common. By detecting the phase delay between emitted and reflected sinusoids, the distance can be measured accurately. However, this harmonic approach does not allow for the concurrent operation of several TOF range cameras because the arbitrary superposition of several differently parametrized sinusoids leads to a sinusoid with incorrect phase. To minimize inaccuracies by multi-camera interference (MCI), pseudonoise (PN) modulated intensity signals are employed for robust TOF range imaging. The time of flight is locally measured by correlating the incident light intensity with two time-shifted versions of the PN sequence, making use of smart demodulation pixels. We derive two fundamental expressions for the basic limitations of TOF measurements using PN sequences. Firstly, the precision of the distance measurement is limited by photon shot noise, and it essentially shows an inverse square root dependence of the number of detected photoelectrons. Secondly, MCI causes an inaccurate distance measurement given as the ratio of two sums. The denominator is the sum of two autocorrelation and two cross-correlation values; the nominator is the sum of one autocorrelation and one cross-correlation value. Due to the lack of a strict mathematical theory of correlation properties of m-sequences, an exhaustive numerical simulation was carried out to obtain expectation values of the distance measurement inaccuracy as a function of the sequence length and the number of interfering cameras. For experimental verification, an image sensor with 176 times 144 demodulation pixels was manufactured with a standard CMOS process offering a CCD option. Measurements taken with up to five concurrently operating sensors were in excellent agreement with our theoretical predictions concerning achievable distance accuracy. This confirms the aptness of PN techniques for multi-camera optical TOF range imaging.

[1]  Rudolf Schwarte,et al.  MSM-PMD as correlation receiver in a new 3D-ranging system , 2002, SPIE Remote Sensing.

[2]  D. G. Kocher,et al.  Three-dimensional imaging laser radar with a photon-counting avalanche photodiode array and microchip laser. , 2002, Applied optics.

[3]  Peter Seitz,et al.  Demonstration of a novel drift field pixel structure for the demodulation of modulated light waves with application in three-dimensional image capture , 2004, IS&T/SPIE Electronic Imaging.

[4]  Thierry Oggier,et al.  CCD / CMOS Lock-In Pixel for Range Imaging : Challenges , Limitations and State-ofthe-Art , 2005 .

[5]  Robert C. Dixon,et al.  Spread spectrum techniques , 1976 .

[6]  W. Brockherde,et al.  A 4/spl times/64 pixel CMOS image sensor for 3-D measurement applications , 2004, IEEE Journal of Solid-State Circuits.

[7]  M. Teich,et al.  Fundamentals of Photonics , 1991 .

[8]  Helmut Fischer,et al.  New electro-optical mixing and correlating sensor: facilities and applications of the photonic mixer device (PMD) , 1997, Other Conferences.

[9]  Miodrag Živković.  A table of primitive binary polynomials , 1994 .

[10]  T. Oggier,et al.  SwissRanger SR 3000 and First Experiences based on Miniaturized 3 D-TOF Cameras , 1968 .

[11]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[12]  A. Finger,et al.  Pseudo Random Signal Processing: Theory and Application , 2005 .

[13]  Hugh D. Luke.  Signalubertragung: Grundlagen Der Digitalen Und Analogen Nachrichtenubertragungssysteme , 1995 .

[14]  Peter Seitz,et al.  The multitap lock-in CCD with offset subtraction , 1997 .

[15]  Miodrag Živković.  Table of primitive binary polynomials. II , 1994 .

[16]  M.B. Pursley,et al.  Crosscorrelation properties of pseudorandom and related sequences , 1980, Proceedings of the IEEE.

[17]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[18]  E. Charbon,et al.  A single photon detector array with 64/spl times/64 resolution and millimetric depth accuracy for 3D imaging , 2005, ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005..

[19]  A. Simoni,et al.  A CMOS smart pixel for active 3-D vision applications , 2004, IEEE Sensors Journal.