Marker encoded fringe projection profilometry for efficient 3D model acquisition.

This paper presents a novel marker encoded fringe projection profilometry (FPP) scheme for efficient 3-dimensional (3D) model acquisition. Traditional FPP schemes can introduce large errors to the reconstructed 3D model when the target object has an abruptly changing height profile. For the proposed scheme, markers are encoded in the projected fringe pattern to resolve the ambiguities in the fringe images due to that problem. Using the analytic complex wavelet transform, the marker cue information can be extracted from the fringe image, and is used to restore the order of the fringes. A series of simulations and experiments have been carried out to verify the proposed scheme. They show that the proposed method can greatly improve the accuracy over the traditional FPP schemes when reconstructing the 3D model of objects with abruptly changing height profile. Since the scheme works directly in our recently proposed complex wavelet FPP framework, it enjoys the same properties that it can be used in real time applications for color objects.

[1]  Cho Jui Tay,et al.  Fringe-density estimation by continuous wavelet transform. , 2005, Applied optics.

[2]  Daniel Pak-Kong Lun,et al.  Image enhancement for fringe projection profilometry , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[3]  Wei-Hung Su,et al.  Calibration-based two-frequency projected fringe profilometry: a robust, accurate, and single-shot measurement for objects with large depth discontinuities. , 2006, Optics express.

[4]  Avideh Zakhor,et al.  Consistent Stereo-Assisted Absolute Phase Unwrapping Methods for Structured Light Systems , 2012, IEEE Journal of Selected Topics in Signal Processing.

[5]  Tak-Wai Hui,et al.  3-D Measurement of Solder Paste Using Two-Step Phase Shift Profilometry , 2008, IEEE Transactions on Electronics Packaging Manufacturing.

[6]  Nick G. Kingsbury,et al.  Multiscale Keypoint Detection using the Dual-Tree Complex Wavelet Transform , 2006, 2006 International Conference on Image Processing.

[7]  Xiaosheng Cheng,et al.  A flexible phase-shifting method with absolute phase marker retrieval , 2012 .

[8]  J. M. Huntley,et al.  Temporal phase-unwrapping algorithm for automated interferogram analysis. , 1993, Applied optics.

[9]  Xianyu Su,et al.  Fourier transform profilometry:: a review , 2001 .

[10]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[11]  Xiaolin Li,et al.  Multilevel quality-guided phase unwrapping algorithm for real-time three-dimensional shape reconstruction. , 2007, Applied optics.

[12]  Tai-Chiu Hsung,et al.  Efficient fringe image enhancement based on dual-tree complex wavelet transform. , 2011, Applied optics.

[13]  K Itoh,et al.  Analysis of the phase unwrapping algorithm. , 1982, Applied optics.

[14]  Peisen S. Huang,et al.  Fast three-step phase-shifting algorithm , 2006 .

[15]  Zhiwei Xiong,et al.  Unambiguous 3D measurement from speckle-embedded fringe. , 2013, Applied optics.

[16]  Song Zhang,et al.  High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm , 2007 .

[17]  Levent Sendur,et al.  Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency , 2002, IEEE Trans. Signal Process..

[18]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[19]  Serhat Özder,et al.  Continuous wavelet transform analysis of projected fringe patterns , 2004 .

[20]  Tai-Chiu Hsung,et al.  Zero spectrum removal using joint bilateral filter for Fourier transform profilometry , 2011, 2011 Visual Communications and Image Processing (VCIP).

[21]  Song Zhang,et al.  High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method. , 2006, Optics express.

[22]  Bo Hu,et al.  A Novel Scheme for the Design of Approximate Hilbert Transform Pairs of Orthonormal Wavelet Bases , 2008, IEEE Transactions on Signal Processing.

[23]  Qi Hao,et al.  Dual-frequency pattern scheme for high-speed 3-D shape measurement. , 2010, Optics express.

[24]  Shree K. Nayar,et al.  Structured Light in Sunlight , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  Feipeng Da,et al.  A novel phase-shifting method based on strip marker , 2010 .

[26]  Francis Lilley,et al.  Spatial fringe pattern analysis using the two-dimensional continuous wavelet transform employing a cost function. , 2007, Applied optics.

[27]  Qi Hao,et al.  Robust Active Stereo Vision Using Kullback-Leibler Divergence , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Tai-Chiu Hsung,et al.  On optical phase shift profilometry based on dual tree complex wavelet transform , 2010, 2010 IEEE International Conference on Image Processing.

[29]  Dennis C. Ghiglia,et al.  Two-Dimensional Phase Unwrapping: Theory, Algorithms, and Software , 1998 .

[30]  Qian Kemao,et al.  Two-dimensional windowed Fourier transform for fringe pattern analysis: Principles, applications and implementations , 2007 .

[31]  Ronald Chung,et al.  An Accurate and Robust Strip-Edge-Based Structured Light Means for Shiny Surface Micromeasurement in 3-D , 2013, IEEE Transactions on Industrial Electronics.

[32]  Xiaoyuan He,et al.  Two-step phase-shifting fringe projection profilometry: intensity derivative approach. , 2007, Applied optics.

[33]  Jianwen Luo,et al.  360° Fourier Transform Profilometry in Surface Reconstruction for Fluorescence Molecular Tomography , 2013, IEEE Journal of Biomedical and Health Informatics.

[34]  I. Selesnick,et al.  Bivariate shrinkage with local variance estimation , 2002, IEEE Signal Processing Letters.

[35]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[36]  C. Werner,et al.  Satellite radar interferometry: Two-dimensional phase unwrapping , 1988 .

[37]  G Sansoni,et al.  Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors. , 1999, Applied optics.

[38]  Nick G. Kingsbury,et al.  A dual-tree complex wavelet transform with improved orthogonality and symmetry properties , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[39]  Tim Weyrich,et al.  A practical structured light acquisition system for point-based geometry and texture , 2005, Proceedings Eurographics/IEEE VGTC Symposium Point-Based Graphics, 2005..

[40]  Soontorn Oraintara,et al.  On the distributions of the relative phase of complex wavelet coefficients , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[41]  Zhiwei Xiong,et al.  Real-Time Scalable Depth Sensing With Hybrid Structured Light Illumination , 2014, IEEE Transactions on Image Processing.

[42]  Qian Kemao,et al.  Windowed Fourier transform for fringe pattern analysis: theoretical analyses. , 2008, Applied optics.

[43]  Daniel Pak-Kong Lun,et al.  Effective bias removal for fringe projection profilometry using the dual-tree complex wavelet transform. , 2012, Applied optics.

[44]  J. Gass,et al.  Phase imaging without 2pi ambiguity by multiwavelength digital holography. , 2003, Optics letters.

[45]  Soontorn Oraintara,et al.  A study of relative phase in complex wavelet domain: Property, statistics and applications in texture image retrieval and segmentation , 2010, Signal Process. Image Commun..

[46]  Yajun Wang,et al.  Modified Fourier transform method for 3D profile measurement without phase unwrapping. , 2010, Optics letters.

[47]  Daniel Pak-Kong Lun,et al.  Efficient 3-dimensional model reconstruction based on marker encoded fringe projection profilometry , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[48]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[49]  Yajun Wang,et al.  Novel phase-coding method for absolute phase retrieval. , 2012, Optics letters.

[50]  Qi Hao,et al.  Period Coded Phase Shifting Strategy for Real–time 3-D Structured Light Illumination , 2011, IEEE Transactions on Image Processing.

[51]  Holger Boche,et al.  Downlink MMSE Transceiver Optimization for Multiuser MIMO Systems: MMSE Balancing , 2008, IEEE Transactions on Signal Processing.