Deformed Phase Prediction Using SVM for Structured Light Depth Generation

In phase-based structured light, absolute phase unwrapping, which is a cumbersome step, is often considered necessary before calculating depth. In this paper, we notice that depth is only related to the deformed phase but not the absolute unwrapped phase. Furthermore, the deformed phase is highly related to the changes of the wrapped reference and captured phases. Based on these findings, we propose a classification-based scheme that can directly report deformed phase. To be specific, we cast the problem of inferring fringe order difference as a multi-class classification task, where phase samples within half a period are fed to the classifier and the fringe oder difference is the class. Besides, we use a radial basis function support vector machine as the classifier. In such a manner, for every pixel, the deformed phase can be obtained directly without knowing the absolute unwrapped phase. Moreover, the proposed method only needs phase from a single frequency and is pixel-independent, so it is free from troubles such as poor real-time performance in temporal unwrapping or error accumulation in spatial unwrapping. Experiments on 3dsmax data and real-captured data prove that the proposed method can produce high quality depth maps.

[1]  Rama Krishna Sai Subrahmanyam Gorthi,et al.  PhaseNet: A Deep Convolutional Neural Network for Two-Dimensional Phase Unwrapping , 2019, IEEE Signal Processing Letters.

[2]  Shahram Izadi,et al.  UltraStereo: Efficient Learning-Based Matching for Active Stereo Systems , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Qian Chen,et al.  High-speed three-dimensional profilometry for multiple objects with complex shapes. , 2012, Optics express.

[4]  Natan T. Shaked,et al.  Phase Unwrapping Using Residual Neural Networks , 2018 .

[5]  Li Yu,et al.  No-Reference Depth Assessment Based on Edge Misalignment Errors for T + D Images , 2016, IEEE Transactions on Image Processing.

[6]  Song Zhang,et al.  Absolute phase retrieval methods for digital fringe projection profilometry: A review , 2018 .

[7]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[8]  Sergio Orts,et al.  HyperDepth: Learning Depth from Structured Light without Matching , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[10]  Qican Zhang,et al.  Quality-guided phase unwrapping technique: comparison of quality maps and guiding strategies. , 2011, Applied optics.

[11]  Cheng Teng,et al.  Absolute phase retrieval via color phase-coding , 2017 .

[12]  Aljoscha Smolic,et al.  3D video and free viewpoint video - From capture to display , 2011, Pattern Recognit..

[13]  Jin Wu,et al.  Hybrid profilometry using a single monochromatic multi-frequency pattern. , 2017, Optics express.

[14]  Roger M Groves,et al.  Phase discontinuity predictions using a machine-learning trained kernel. , 2014, Applied optics.

[15]  Peisen S. Huang,et al.  Fast three-step phase-shifting algorithm , 2006 .

[16]  Song Zhang,et al.  High-speed 3D shape measurement with structured light methods: A review , 2018, Optics and Lasers in Engineering.

[17]  Xin He,et al.  Cross-View Multi-Lateral Filter for Compressed Multi-View Depth Video , 2019, IEEE Transactions on Image Processing.

[18]  Qiong Liu,et al.  A Two-Stage Clustering Based 3D Visual Saliency Model for Dynamic Scenarios , 2019, IEEE Transactions on Multimedia.

[19]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[20]  Zhiyang Dai,et al.  An Accurate Phase Unwrapping Algorithm Based on Reliability Sorting and Residue Mask , 2012, IEEE Geoscience and Remote Sensing Letters.

[21]  Sen Zhang,et al.  An Improved Quality-Guided Phase-Unwrapping Algorithm Based on Priority Queue , 2011, IEEE Geoscience and Remote Sensing Letters.

[22]  Zhenkun Lei,et al.  Multi-frequency inverse-phase fringe projection profilometry for nonlinear phase error compensation , 2015 .