Event-Based Structured Light for Depth Reconstruction using Frequency Tagged Light Patterns

This paper presents a new method for 3D depth estimation using the output of an asynchronous time driven image sensor. In association with a high speed Digital Light Processing projection system, our method achieves real-time reconstruction of 3D points cloud, up to several hundreds of hertz. Unlike state of the art methodology, we introduce a method that relies on the use of frequency tagged light pattern that make use of the high temporal resolution of event based sensors. This approch eases matching as each pattern unique frequency allow for any easy matching between displayed patterns and the event based sensor. Results are show on real scenes.

[1]  Xianyu Su,et al.  Fourier transform profilometry:: a review , 2001 .

[2]  Andreas G. Andreou,et al.  A Contrast Sensitive Silicon Retina with Reciprocal Synapses , 1991, NIPS.

[3]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[4]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[5]  Masato Nakashima,et al.  Wide-Area, High Dynamic Range 3-D Imager , 1990, Other Conferences.

[6]  Roland T. Chin,et al.  Automated visual inspection: 1981 to 1987 , 1988, Computer Vision Graphics and Image Processing.

[7]  Bernabé Linares-Barranco,et al.  A 3.6 $\mu$ s Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor , 2011, IEEE Journal of Solid-State Circuits.

[8]  C Guan,et al.  Composite structured light pattern for three-dimensional video. , 2003, Optics express.

[9]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[10]  Pierre Graebling,et al.  A pattern framework driven by the Hamming distance for structured light-based reconstruction with a single image , 2011, CVPR 2011.

[11]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[12]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[14]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[15]  Alan A. Stocker,et al.  Analog integrated 2-D optical flow sensor with programmable pixels , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[16]  E. Petriu,et al.  Object recognition using pseudo-random color encoded structured light , 2000, Proceedings of the 17th IEEE Instrumentation and Measurement Technology Conference [Cat. No. 00CH37066].

[17]  Jeffrey L. Posdamer,et al.  Surface measurement by space-encoded projected beam systems , 1982, Comput. Graph. Image Process..

[18]  N. Ono,et al.  Real-time 3D imager based on spatio-temporal phase unwrapping , 2004, SICE 2004 Annual Conference.

[19]  José María Armingol Moreno,et al.  Continuous mobile robot localization by using structured light and a geometric map , 1996, Int. J. Syst. Sci..

[20]  Avinash C. Kak,et al.  Dual-beam structured-light scanning for 3-D object modeling , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[21]  Daniel Matolin,et al.  A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS , 2011, IEEE Journal of Solid-State Circuits.

[22]  N. G. Durdle,et al.  An improved structured light technique for surface reconstruction of the human trunk , 1998, Conference Proceedings. IEEE Canadian Conference on Electrical and Computer Engineering (Cat. No.98TH8341).

[23]  Minoru Asada,et al.  Map building for a mobile robot from sensory data , 1990, IEEE Trans. Syst. Man Cybern..

[24]  Tom Fleischer.  Computer Vision Three Dimensional Data From Images , 2016 .

[25]  S. Inokuchi,et al.  Range-imaging system for 3-D object recognition , 1984 .

[26]  Dirk Bergmann.  New approach for automatic surface reconstruction with coded light , 1995, Optics & Photonics.

[27]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[28]  Minoru Maruyama,et al.  Range Sensing By Projecting Multiple Slits With Random Cuts , 1990, Other Conferences.

[29]  Pierre Graebling,et al.  Design of a Monochromatic Pattern for a Robust Structured Light Coding , 2007, 2007 IEEE International Conference on Image Processing.

[30]  Johji Tajima,et al.  3-D data acquisition by Rainbow Range Finder , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[31]  Tokuo Tsuji,et al.  High-speed 3D image acquisition using coded structured light projection , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Mongi A. Abidi,et al.  Laser‐based imaging for reverse engineering , 2003 .

[33]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[34]  Song Zhang,et al.  Superfast phase-shifting method for 3-D shape measurement. , 2010, Optics express.