Multi-state objects depth acquisition based on binocular structured light

Abstract Three-dimensional depth perception using structured light has been widely researched and developed due to its robustness, high precision, and density. An open research issue exists with current structured light technology to obtain depth maps of scenes with objects in different motion states, while ensuring high accuracy and resolution. In this paper, a new algorithm for depth acquisition of multi-state targets is designed. A novel projection pattern is designed based on sinusoidal, speckle and line patterns. The foreground targets are separated according to the background segmentation technology, and regions with different motion states are divided into static, slow motion or fast motion regions. Then, the different motion states are used to select different pattern decoding schemes. In the experiments, the depth of multi-state objects are successfully calculated by our technique.

[1]  X. Su,et al.  3D shape from phase errors by using binary fringe with multi-step phase-shift technique , 2015 .

[2]  Guangming Shi,et al.  Single-shot dense depth sensing with frequency-division multiplexing fringe projection , 2017, J. Vis. Commun. Image Represent..

[3]  Song Zhang,et al.  High-speed 3D shape measurement with structured light methods: A review , 2018, Optics and Lasers in Engineering.

[4]  S. Xing,et al.  Temporal phase unwrapping for fringe projection profilometry aided by recursion of Chebyshev polynomials. , 2017, Applied optics.

[5]  Zhiwei Xiong,et al.  Real-Time Scalable Depth Sensing With Hybrid Structured Light Illumination , 2014, IEEE Transactions on Image Processing.

[6]  Jin Wu,et al.  Hybrid profilometry using a single monochromatic multi-frequency pattern. , 2017, Optics express.

[7]  Beiwen Li,et al.  High-dynamic-range 3D shape measurement utilizing the transitioning state of digital micromirror device , 2018, Optics and Lasers in Engineering.

[8]  Hualie Jiang,et al.  A high dynamic range structured light means for the 3D measurement of specular surface , 2017 .

[9]  Shenghui Zhao,et al.  Accurate Dynamic 3D Sensing With Fourier-Assisted Phase Shifting , 2015, IEEE Journal of Selected Topics in Signal Processing.

[10]  Yajun Wang,et al.  Modified Gray-Level Coding Method for Absolute Phase Retrieval , 2017, Sensors.

[11]  Andrew W. Fitzgibbon,et al.  Real-time non-rigid reconstruction using an RGB-D camera , 2014, ACM Trans. Graph..

[12]  W. Su,et al.  One-shot profile inspection for surfaces with depth, color and reflectivity discontinuities. , 2017, Optics express.

[13]  Jing Xu,et al.  An omnidirectional 3D sensor with line laser scanning , 2016 .

[14]  Jian Wang,et al.  Dual Structured Light 3D Using a 1D Sensor , 2016, ECCV.

[15]  Chang Liu,et al.  An improved spatiotemporal correlation method for high-accuracy random speckle 3D reconstruction , 2018, Optics and Lasers in Engineering.

[16]  Tong Jia,et al.  Scene Depth Perception Based on Omnidirectional Structured Light , 2016, IEEE Transactions on Image Processing.

[17]  Qian Chen,et al.  Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system. , 2016, Optics express.

[18]  Ryo Furukawa,et al.  Depth Estimation Using Structured Light Flow — Analysis of Projected Pattern Flow on an Object’s Surface , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Andrew W. Fitzgibbon,et al.  Kinectrack: 3D Pose Estimation Using a Projected Dense Dot Pattern , 2014, IEEE Transactions on Visualization and Computer Graphics.

[20]  Feipeng Da,et al.  High-quality defocusing phase-shifting profilometry on dynamic objects , 2018, Optical Engineering.

[21]  Qingxiong Yang,et al.  Stereo Matching Using Tree Filtering , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yanjun Fu,et al.  A fast 3D shape measurement method based on sinusoidal and triangular fringe projection , 2018 .

[23]  Song Zhang,et al.  Superfast 3D absolute shape measurement using five binary patterns , 2017 .

[24]  Tong Jia,et al.  A phase unwrapping method based on sparse depth for depth perception , 2018, Optics and Lasers in Engineering.

[25]  Nanning Zheng,et al.  A High Spatial Resolution Depth Sensing Method Based on Binocular Structured Light , 2017, Sensors.

[26]  Beiwen Li,et al.  Microscopic structured light 3D profilometry: Binary defocusing technique vs. sinusoidal fringe projection , 2017 .