Adaptive microphase measuring profilometry for three-dimensional shape reconstruction of a shiny surface

Abstract. Three-dimensional (3-D) reconstruction of a shiny surface is a great challenge for existing structured light techniques because serious measurement errors will occur in image saturation regions in the captured image. To this end, an adaptive microphase measuring profilometry (AMPMP) is proposed. In this method, an optimal frequency selection strategy is introduced to select the frequencies of phase-shifted fringe patterns. The intensity relation between the projected pattern and the captured image is estimated by fitting a nonlinear function after projecting a series of uniform gray-level patterns onto the shiny surface, and the mapping regions of saturated areas in the captured image are computed with the correspondence between the projector image plane and the camera image plane, which is established through MPMP. Based on the estimated intensity relation and the mapping regions, the optimal projection intensities of saturated areas are adaptively adjusted. Then, the adjusted phase-shifted fringe patterns are projected to obtain the absolute phase distribution of the shiny surface. Therefore, accurate 3-D shape reconstruction is realized. The experimental results demonstrated that the proposed AMPMP can well tackle saturated areas of shiny surfaces and has greater performance than other commonly used adaptive fringe projection techniques.

[1]  S. Ri,et al.  Intensity range extension method for three-dimensional shape measurement in phase-measuring profilometry using a digital micromirror device camera. , 2008, Applied optics.

[2]  Song Zhang,et al.  High dynamic range scanning technique , 2009 .

[3]  Nan Gao,et al.  Adaptive pixel-to-pixel projection intensity adjustment for measuring a shiny surface using orthogonal color fringe pattern projection , 2018 .

[4]  Todd E. Zickler,et al.  A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance , 2010, ACM Trans. Graph..

[5]  Beiwen Li,et al.  High-dynamic-range 3D shape measurement utilizing the transitioning state of digital micromirror device , 2018, Optics and Lasers in Engineering.

[6]  Hualie Jiang,et al.  A high dynamic range structured light means for the 3D measurement of specular surface , 2017 .

[7]  Shree K. Nayar,et al.  Micro Phase Shifting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Chao Chen,et al.  Adaptive projection intensity adjustment for avoiding saturation in three-dimensional shape measurement , 2018 .

[9]  Jing Xu,et al.  A Robust Surface Coding Method for Optically Challenging Objects Using Structured Light , 2014, IEEE Transactions on Automation Science and Engineering.

[10]  Hui Lin,et al.  Three-dimensional shape measurement technique for shiny surfaces by adaptive pixel-wise projection intensity adjustment , 2017 .

[11]  Suming Tang,et al.  High dynamic range three-dimensional shape reconstruction via an auto-exposure-based structured light technique , 2019 .

[12]  Dong Li,et al.  Adaptive fringe-pattern projection for image saturation avoidance in 3D surface-shape measurement. , 2014, Optics express.

[13]  Joongki Jeong,et al.  Adaptive imaging system with spatial light modulator for robust shape measurement of partially specular objects. , 2010, Optics express.

[14]  Jonathan Kofman,et al.  Saturation avoidance by adaptive fringe projection in phase-shifting 3D surface-shape measurement , 2010, 2010 International Symposium on Optomechatronic Technologies.

[15]  Faramarz Farahi,et al.  Dynamics range enhancement in digital fringe projection technique , 2015 .

[16]  Wang Peng,et al.  3D laser scanner system using high dynamic range imaging , 2014 .

[17]  Ronald Chung,et al.  An Accurate and Robust Strip-Edge-Based Structured Light Means for Shiny Surface Micromeasurement in 3-D , 2013, IEEE Transactions on Industrial Electronics.

[18]  Hyungsuck Cho,et al.  Measurement of partially specular objects by controlling imaging range , 2007, International Symposium on Optomechatronic Technologies.

[19]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[20]  Suming Tang,et al.  Three-dimensional profilometry with mixed binary defocusing technique , 2016 .

[21]  Chao Xing,et al.  Highlight removal based on the regional-projection fringe projection method , 2018 .

[22]  Basel Salahieh,et al.  Multi-polarization fringe projection imaging for high dynamic range objects. , 2014, Optics express.

[23]  Xiang-Gen Xia,et al.  Phase Unwrapping and A Robust Chinese Remainder Theorem , 2007, IEEE Signal Processing Letters.

[24]  Hui Lin,et al.  Adaptive digital fringe projection technique for high dynamic range three-dimensional shape measurement. , 2016, Optics express.

[25]  Shijie Feng,et al.  General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique , 2014 .

[26]  Xu Zhang,et al.  Evaluation of coded structured light methods using ground truth , 2011, 2011 IEEE 5th International Conference on Cybernetics and Intelligent Systems (CIS).

[27]  Hongzhi Jiang,et al.  High dynamic range fringe acquisition: A novel 3-D scanning technique for high-reflective surfaces , 2012 .

[28]  Feipeng Da,et al.  Adaptive fringe projection technique for high-dynamic range three-dimensional shape measurement using binary search , 2017 .

[29]  Suming Tang,et al.  Micro-phase measuring profilometry: Its sensitivity analysis and phase unwrapping , 2015 .

[30]  Shree K. Nayar,et al.  Diffuse structured light , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[31]  Xu Zhang,et al.  Projector calibration from the camera image point of view , 2009 .

[32]  Zhiwei Xiong,et al.  Unambiguous 3D measurement from speckle-embedded fringe. , 2013, Applied optics.

[33]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[34]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[35]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[36]  Feipeng Da,et al.  High dynamic range 3D shape determination based on automatic exposure selection , 2018, J. Vis. Commun. Image Represent..