High dynamic range three-dimensional shape reconstruction via an auto-exposure-based structured light technique

Abstract. High dynamic range object has large surface reflectivity variations, which easily produces saturated and low-contrast regions in the captured images, further resulting in large calculation errors of gray value or phase value, then seriously affecting the reconstruction accuracy. An auto-exposure-based structured light technique is proposed. In this method, the relationship between noise-induced phase error and intensity modulation is first analyzed. It is demonstrated that once the intensity modulation of a pixel is larger than a threshold, its phase error can be considered acceptable. Then, the surface reflectivity of the measured target is estimated by projecting a series of uniform gray-level patterns and classified into several groups. The exposure time for each group is automatically determined after establishing its mathematical model based on the modulation threshold. Phase-shifted images are then captured at the computed exposure times, and a set of composite phase-shifted images is acquired by extracting the brightest unsaturated pixels in the raw fringe images. The experiments show that the proposed method can automatically calculate the exposure times and capture the fringe images without human intervention. In addition, it can well tackle saturated and dark areas of the measured target and the reconstructed three-dimensional shape is complete and accurate.

[1]  Zhongwei Li,et al.  Gamma-distorted fringe image modeling and accurate gamma correction for fast phase measuring profilometry. , 2011, Optics letters.

[2]  Faramarz Farahi,et al.  Dynamics range enhancement in digital fringe projection technique , 2015 .

[3]  Song Zhang,et al.  High dynamic range scanning technique , 2009 .

[4]  Xu Zhang,et al.  Projector calibration from the camera image point of view , 2009 .

[5]  Suming Tang,et al.  Micro-phase measuring profilometry: Its sensitivity analysis and phase unwrapping , 2015 .

[6]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  Shree K. Nayar,et al.  Diffuse structured light , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[8]  Feipeng Da,et al.  Adaptive fringe projection technique for high-dynamic range three-dimensional shape measurement using binary search , 2017 .

[9]  Hui Li,et al.  Enhanced high dynamic range 3D shape measurement based on generalized phase-shifting algorithm , 2016, ArXiv.

[10]  Song Zhang,et al.  Generic nonsinusoidal phase error correction for three-dimensional shape measurement using a digital video projector. , 2007, Applied optics.

[11]  Song Zhang,et al.  Autoexposure for three-dimensional shape measurement using a digital-light-processing projector , 2011 .

[12]  Shijie Feng,et al.  General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique , 2014 .

[13]  Ronald Chung,et al.  An Accurate and Robust Strip-Edge-Based Structured Light Means for Shiny Surface Micromeasurement in 3-D , 2013, IEEE Transactions on Industrial Electronics.

[14]  Ashok Veeraraghavan,et al.  Structured light 3D scanning in the presence of global illumination , 2011, CVPR 2011.

[15]  Jason Lawrence,et al.  A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance , 2010, ACM Transactions on Graphics.

[16]  Jibin Zhao,et al.  Analysis and reduction of phase errors caused by nonuniform surface reflectivity in a phase-shifting measurement system , 2017 .

[17]  Basel Salahieh,et al.  Multi-polarization fringe projection imaging for high dynamic range objects. , 2014, Optics express.

[18]  Chao Chen,et al.  Adaptive projection intensity adjustment for avoiding saturation in three-dimensional shape measurement , 2018 .

[19]  Jing Xu,et al.  A Robust Surface Coding Method for Optically Challenging Objects Using Structured Light , 2014, IEEE Transactions on Automation Science and Engineering.

[20]  S. Ri,et al.  Intensity range extension method for three-dimensional shape measurement in phase-measuring profilometry using a digital micromirror device camera. , 2008, Applied optics.

[21]  Nan Gao,et al.  Adaptive pixel-to-pixel projection intensity adjustment for measuring a shiny surface using orthogonal color fringe pattern projection , 2018 .

[22]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[23]  Beiwen Li,et al.  High-dynamic-range 3D shape measurement utilizing the transitioning state of digital micromirror device , 2018, Optics and Lasers in Engineering.

[24]  Hualie Jiang,et al.  A high dynamic range structured light means for the 3D measurement of specular surface , 2017 .

[25]  Shree K. Nayar,et al.  Micro Phase Shifting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Joongki Jeong,et al.  Adaptive imaging system with spatial light modulator for robust shape measurement of partially specular objects. , 2010, Optics express.

[27]  Hui Lin,et al.  Three-dimensional shape measurement technique for shiny surfaces by adaptive pixel-wise projection intensity adjustment , 2017 .

[28]  Hongzhi Jiang,et al.  High dynamic range fringe acquisition: A novel 3-D scanning technique for high-reflective surfaces , 2012 .

[29]  Jonathan Kofman,et al.  Saturation avoidance by adaptive fringe projection in phase-shifting 3D surface-shape measurement , 2010, 2010 International Symposium on Optomechatronic Technologies.

[30]  Feipeng Da,et al.  High dynamic range 3D shape determination based on automatic exposure selection , 2018, J. Vis. Commun. Image Represent..

[31]  Wang Peng,et al.  3D laser scanner system using high dynamic range imaging , 2014 .

[32]  Hyungsuck Cho,et al.  Measurement of partially specular objects by controlling imaging range , 2007, International Symposium on Optomechatronic Technologies.