A real-time 3D shape measurement with color texture using a monochromatic camera

Abstract High-speed real-time three-dimensional (3D) shape measurement with color texture has a large potential in various fields. The majority of the existing methods retrieve the 3D shape with color texture by employing an RGB camera or additional infrared camera; however, the RGB camera is more expensive and has lower sensitivity to light, and employing additional infrared camera requires complex alignment. Given this, a novel method is proposed to simultaneously retrieve the 3D shape and color texture. Specifically, compared with the existing methods, the proposed method only uses one monochromatic camera; as a result, the cameras alignment is not required, simplifying the 3D measurement system and reducing its cost. Three fringe patterns with different frequencies and three corresponding uniform gray-level patterns are set to different colors of red, green, and blue. Then Fourier transform profilometry (FTP) is employed to retrieve the 3D shape from the captured six images. While three uniform gray-level patterns can be used to eliminate the effects of the zero frequency term, they can be also used to generate the color texture of objects meanwhile. The proposed method only requires the capture of six monochromes, and the experimental results demonstrate the success of the proposed method.

[1]  Peisen S. Huang,et al.  3-D shape measurement by use of a modified Fourier transform method , 2008, Optical Engineering + Applications.

[2]  Yajun Wang,et al.  Flexible real-time natural 2D color and 3D shape measurement. , 2013, Optics express.

[3]  Qican Zhang,et al.  Dynamic 3-D shape measurement method: A review , 2010 .

[4]  Xianyu Su,et al.  Two-dimensional Fourier transform profilometry for the automatic measurement of three-dimensional object shapes , 1995 .

[5]  Anand K. Asundi,et al.  Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10, 000 frames per second , 2017, ArXiv.

[6]  Qian Chen,et al.  Phase shifting algorithms for fringe projection profilometry: A review , 2018, Optics and Lasers in Engineering.

[7]  Xiang Peng,et al.  Strategy for automatic and complete three-dimensional optical digitization. , 2012, Optics letters.

[8]  Qian Kemao,et al.  Windowed Fourier transform for fringe pattern analysis. , 2004, Applied optics.

[9]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[10]  Song Zhang,et al.  High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm , 2007 .

[11]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[12]  Xianyu Su,et al.  Eliminating the zero spectrum in Fourier transform profilometry using empirical mode decomposition. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  Xianyu Su,et al.  Fourier transform profilometry:: a review , 2001 .

[14]  V. Srinivasan,et al.  Automated phase-measuring profilometry of 3-D diffuse objects. , 1984, Applied optics.

[15]  Zhan Song,et al.  A single-shot structured light means by encoding both color and geometrical features , 2016, Pattern Recognit..

[16]  Song Zhang Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .

[17]  Jingang Zhong,et al.  Spatial carrier-fringe pattern analysis by means of wavelet transform: wavelet transform profilometry. , 2004, Applied optics.

[18]  X. Su,et al.  Improved Fourier transform profilometry for the automatic measurement of 3D object shapes , 1990 .

[19]  David P. Towers,et al.  Robust color and shape measurement of full color artifacts by RGB fringe projection , 2012 .

[20]  Qian Kemao,et al.  Two-dimensional windowed Fourier transform for fringe pattern analysis: Principles, applications and implementations , 2007 .

[21]  Qian Chen,et al.  Motion-artifact-free dynamic 3D shape measurement with hybrid Fourier-transform phase-shifting profilometry. , 2019, Optics express.

[22]  Anand Asundi,et al.  Comparison of Fourier transform, windowed Fourier transform, and wavelet transform methods for phase extraction from a single fringe pattern in fringe projection profilometry , 2010 .

[23]  Xiang Peng,et al.  Color texture extraction from fringe image based on full-field projection , 2003 .

[24]  Tong Guo,et al.  Simple, flexible calibration of phase calculation-based three-dimensional imaging system. , 2011, Optics letters.

[25]  Yan Li,et al.  A non-encoding structured light approach with infrared illumination for 3D large field shape measurement , 2013 .

[26]  Chao Chen,et al.  Simultaneously measuring 3D shape and colour texture of moving objects using IR and colour fringe projection techniques , 2014 .

[27]  Gunther Notni,et al.  Simultaneous measurement of 3D shape and color of objects , 2002, SPIE Optics + Photonics.