An improved spatiotemporal correlation method for high-accuracy random speckle 3D reconstruction

Abstract The single-shot random speckle pattern method can be used for dynamic scene 3D reconstruction. However, the homonymous points search process based on spatial correlation is sensitive to changes in factors such as illumination, perspective, and curvature, which results in low reconstruction accuracy. This paper proposes an improved random speckle 3D reconstruction method with enhanced reconstruction accuracy. To accurately search homonymous points, the proposed method employs a novel spatiotemporal correlation model simultaneously with a subpixel interpolation strategy. Analysis conducted of the reconstruction accuracy associated with correlation region size and the number of patterns to be projected based on the model indicate that using a few (e.g., three) speckle patterns with an appropriate correlation size produces highly accurate results. Experimental results further verify that the proposed method is suitable for high-accuracy dynamic 3D shape measurement.

[1]  Wilfried Philips,et al.  Improved Newton-Raphson digital image correlation method for full-field displacement and strain calculation. , 2010, Applied optics.

[2]  Giovanna Sansoni,et al.  State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation , 2009, Sensors.

[3]  Christian Bräuer-Burchardt,et al.  High-speed three-dimensional measurements with a fringe projection-based optical sensor , 2014 .

[4]  Hugh Alan Bruck,et al.  Digital image correlation using Newton-Raphson method of partial differential correction , 1989 .

[5]  Hao Jiang,et al.  Calibration of fringe projection profilometry using an inaccurate 2D reference target , 2017 .

[6]  Zonghua Zhang,et al.  Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques , 2012 .

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Federico Tombari,et al.  ZNCC-based template matching using bounded partial correlation , 2004 .

[9]  Anand Asundi,et al.  Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review , 2009 .

[10]  P. Albrecht,et al.  Stereo photogrammetry with improved spatial resolution , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[11]  Yan Zhao,et al.  3D fingerprint imaging system based on full-field fringe projection profilometry , 2014 .

[12]  Martin Schaffer,et al.  3D shape measurement of static and moving objects with adaptive spatiotemporal correlation. , 2014, Applied optics.

[13]  M. Sutton,et al.  Systematic errors in digital image correlation due to undermatched subset shape functions , 2002 .

[14]  Martin Schaffer,et al.  High-speed pattern projection for three-dimensional shape measurement using laser speckles. , 2010, Applied optics.

[15]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[16]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[17]  Song Zhang,et al.  Superfast phase-shifting method for 3-D shape measurement. , 2010, Optics express.

[18]  Martin Schaffer,et al.  Fast data acquisition for three-dimensional shape measurement using fixed-pattern projection and temporal coding , 2011 .

[19]  M. Große,et al.  Space-Time Multiplexing in a Stereo-photogrammetry Setup , 2009 .

[20]  Wilfried Philips,et al.  Pixel-level robust digital image correlation. , 2013, Optics express.