Single-shot 3D shape reconstruction using multi-wavelength pattern projection

This paper presents an approach for single-shot 3D shape reconstruction using a multi-wavelength array projector and a stereo-vision setup of two multispectral snapshot cameras. Thus, a sequence of six to eight aperiodic fringe patterns can be simultaneously projected at different wavelengths by the developed array projector and captured by the multispectral snapshot cameras. For the calculation of 3D point clouds, a computational procedure for pattern extraction from single multispectral images, denoising of multispectral image data, and stereo matching is developed. In addition, a proof-of-concept is provided with experimental measurement results, showing the validity and potential of the proposed approach.

[1]  M. J. Deprenger,et al.  Imaging with multi-spectral mosaic-array cameras. , 2015, Applied optics.

[2]  Alfred Schmitt,et al.  Real-Time Stereo by using Dynamic Programming , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  Peter Kühmstedt,et al.  Fast 3D NIR systems for facial measurement and lip-reading , 2017, Commercial + Scientific Sensing and Imaging.

[4]  Andreas Tünnermann,et al.  GOBO projection for 3D measurements at highest frame rates: a performance analysis , 2018, Light: Science & Applications.

[5]  Jiangtao Xi,et al.  3D shape measurement based on projection of triangular patterns of two selected frequencies. , 2014, Optics express.

[6]  Peter Kühmstedt,et al.  Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement , 2014 .

[7]  Adrian Stern,et al.  Compressive 4D spectro-volumetric imaging. , 2016, Optics letters.

[8]  Andy Lambrechts,et al.  A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic , 2014, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[9]  Andreas Tünnermann,et al.  Theoretical considerations on aperiodic sinusoidal fringes in comparison to phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement. , 2015, Applied optics.

[10]  Tong Guo,et al.  Absolute phase calculation from one composite RGB fringe pattern image by wavelet transform algorithm , 2011, International Conference on Optical Instruments and Technology.

[11]  Philippe Soussan,et al.  A CMOS-compatible, integrated approach to hyper- and multispectral imaging , 2014, 2014 IEEE International Electron Devices Meeting.

[12]  Yang Wang,et al.  A Novel Color Encoding Fringe Projection Profilometry based on Wavelet Ridge Technology and Phase-Crossing , 2018 .

[13]  A. Tünnermann,et al.  High-speed three-dimensional shape measurement using GOBO projection , 2016 .

[14]  Tong Guo,et al.  Absolute phase calculation from one composite RGB fringe pattern image by windowed Fourier transform algorithm , 2010, SPIE/COS Photonics Asia.

[15]  Lawrence Carin,et al.  Spectral-temporal compressive imaging. , 2015, Optics letters.

[16]  Xin Yuan,et al.  Image translation for single-shot focal tomography , 2015 .

[17]  Henry Arguello,et al.  Snapshot colored compressive spectral imager. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Peisen S. Huang,et al.  3-D shape measurement by use of a modified Fourier transform method , 2008, Optical Engineering + Applications.

[19]  Richard I. Hartley,et al.  Theory and Practice of Projective Rectification , 1999, International Journal of Computer Vision.

[20]  C Guan,et al.  Composite structured light pattern for three-dimensional video. , 2003, Optics express.

[21]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[22]  Jae-Sang Hyun,et al.  High-speed and high-accuracy 3D surface measurement using a mechanical projector. , 2018, Optics express.

[23]  Andreas Tünnermann,et al.  Experimental comparison of aperiodic sinusoidal fringes and phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement , 2016 .

[24]  Neus Sabater,et al.  How Accurate Can Block Matches Be in Stereo Vision? , 2011, SIAM J. Imaging Sci..

[25]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[26]  Andreas Tünnermann,et al.  5D hyperspectral imaging: fast and accurate measurement of surface shape and spectral characteristics using structured light. , 2018, Optics express.

[27]  Martin Schaffer,et al.  High-speed three-dimensional shape measurements of objects with laser speckles and acousto-optical deflection. , 2011, Optics letters.

[28]  Christian Bräuer-Burchardt,et al.  Fringe projection based high-speed 3D sensor for real-time measurements , 2011, Optical Metrology.

[29]  Bin Liang,et al.  Depth Errors Analysis and Correction for Time-of-Flight (ToF) Cameras , 2017, Sensors.

[30]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[31]  Gunther Notni,et al.  A novel 3D multispectral vision system based on filter wheel cameras , 2016, 2016 IEEE International Conference on Imaging Systems and Techniques (IST).

[32]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..