Fast Stereo 3D Imaging Based on Random Speckle Projection and Its FPGA Implementation

In this paper, we propose a fast stereo 3D imaging technique based on random speckle projection and its FPGA implementation. Stereo vision, as a classic passive method for 3D shape measurement based on the multi-view geometric constraints, can realize the 3D reconstruction of the tested scene using a pair of images captured through the binocular cameras. In addition, some complicated matching techniques, such as graph cut and block matching, are used to obtain a global disparity map but it leads to massive computing overhead. To solve this problem, we developed a fast stereo vision system based on FPGA. Benefiting from the full parallel architecture of FPGA, the complete computational framework is based on a full pipeline design, that is, the storage and calculation of data are performed under the system clock to implement different works of stereo vision (including stereo rectify and stereo matching) at the same time, promoting calculation speed and measurement efficiency. In order to further improve the accuracy of 3D measurement, by introducing structured light illumination into the existing system, a projection system based on random speckle is designed where fast speckle projection and synchronous acquisition are realized on the FPGA hardware. Experimental results verify that our method can achieve high-speed and robust 3D shape measurement.

[1]  Zhang Liang,et al.  High dynamic range 3D measurements with fringe projection profilometry: a review , 2018 .

[2]  Qian Chen,et al.  Phase shifting algorithms for fringe projection profilometry: A review , 2018, Optics and Lasers in Engineering.

[3]  Qian Chen,et al.  High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping , 2019, Optics and Lasers in Engineering.

[4]  Anand Asundi,et al.  Improved speckle projection profilometry for out-of-plane shape measurement. , 2008, Applied optics.

[5]  Peter I. Corke,et al.  Real-time stereopsis using FPGAs , 1997, FPL.

[6]  Jae Wook Jeon,et al.  FPGA Design and Implementation of a Real-Time Stereo Vision System , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Jilin Liu,et al.  Improved real-time correlation-based FPGA stereo vision system , 2010, 2010 IEEE International Conference on Mechatronics and Automation.

[8]  Pei Zhou,et al.  Optical 3-D surface reconstruction with color binary speckle pattern encoding. , 2018, Optics express.

[9]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[10]  Diederik Verkest,et al.  Real-time high-definition stereo matching on FPGA , 2011, FPGA '11.

[11]  Axel Wiegmann,et al.  Human face measurement by projecting bandlimited random patterns. , 2006, Optics express.

[12]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Martin Schaffer,et al.  Statistical patterns: an approach for high-speed and high-accuracy shape measurements , 2014 .

[14]  Pengwan Chen,et al.  Evaluation of the quality of a speckle pattern in the digital image correlation method by mean subset fluctuation , 2011 .

[15]  Masanori Hariyama,et al.  FPGA implementation of a stereo matching processor based on window-parallel-and-pixel-parallel architecture , 2005 .

[16]  Shijie Feng,et al.  Real-time binocular stereo vision system based on FPGA , 2018, Other Conferences.

[17]  L. Cristofolini,et al.  A practical approach to optimizing the preparation of speckle patterns for digital-image correlation , 2014 .

[18]  Huimin Xie,et al.  Mean intensity gradient: An effective global parameter for quality assessment of the speckle patterns used in digital image correlation , 2010 .

[19]  H. K. Nishihara.  Real-time stereo- and motion-based figure ground discrimination and tracking using LOG sign correlation , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[20]  Qian Chen,et al.  High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system. , 2019, Optics express.