Recent progresses on real-time 3D shape measurement using digital fringe projection techniques

Over the past few years, we have been developing techniques for high-speed 3D shape measurement using digital fringe projection and phase-shifting techniques: various algorithms have been developed to improve the phase computation speed, parallel programming has been employed to further increase the processing speed, and advanced hardware technologies have been adopted to boost the speed of coordinate calculations and 3D geometry rendering. We have successfully achieved simultaneous 3D absolute shape acquisition, reconstruction, and display at a speed of 30 frames/s with 300 K points per frame. This paper presents the principles of the real-time 3D shape measurement techniques that we developed, summarizes the most recent progresses that have been made in this field, and discusses the challenges for advancing this technology further.

[1]  Stephen Charles Hsu,et al.  Performance of a Time-of-Flight Range Camera for Intelligent Vehicle Safety Applications , 2006 .

[2]  R. Chellappa.  Introduction of New Editor-in-Chief , 2005 .

[3]  Song Zhang,et al.  High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method. , 2006, Optics express.

[4]  J. Jones,et al.  Optimum frequency selection in multifrequency interferometry. , 2003, Optics letters.

[5]  Sen Wang,et al.  High Resolution Tracking of Non-Rigid Motion of Densely Sampled 3D Data Using Harmonic Maps , 2008, International Journal of Computer Vision.

[6]  Zhongwei Li,et al.  Accurate calibration method for a structured light system , 2008 .

[7]  Jürgen Valldorf,et al.  Advanced Microsystems for Automotive Applications 2006 , 2006 .

[8]  Fu-Pen Chiang,et al.  Trapezoidal phase-shifting method for three-dimensional shape measurement , 2005 .

[9]  Song Zhang,et al.  High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm , 2007 .

[10]  Peisen S. Huang,et al.  Fast three-step phase-shifting algorithm , 2006 .

[11]  J. Wyant,et al.  Multiple-wavelength phase-shifting interferometry. , 1985, Applied optics.

[12]  Peisen S. Huang,et al.  3-D shape measurement by use of a modified Fourier transform method , 2008, Optical Engineering + Applications.

[13]  Beverly Barton.  Radiohead "House of Cards" , 2009, SIGGRAPH '09.

[14]  Song Zhang,et al.  High dynamic range scanning technique , 2009 .

[15]  Salah Karout,et al.  Two-dimensional phase unwrapping , 2007 .

[16]  Szymon Rusinkiewicz,et al.  Spacetime Stereo: A Unifying Framework for Depth from Triangulation , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  M. K. Kim,et al.  LED-based multi-wavelength phase imaging interference microscopy. , 2007, Optics express.

[18]  Sen Wang,et al.  High resolution tracking of non-rigid 3D motion of densely sampled data using harmonic maps , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[19]  Kevin George Harding,et al.  Shiny parts measurement using color separation , 2005, SPIE Optics East.

[20]  Peisen S. Huang,et al.  Novel method for structured light system calibration , 2006 .

[21]  Thomas J. Flynn,et al.  TWO-DIMENSIONAL PHASE UNWRAPPING WITH MINIMUM WEIGHTED DISCONTINUITY , 1997 .

[22]  Jin-Jung Chyou,et al.  Two-dimensional phase unwrapping with a multichannel least-mean-square algorithm. , 2004, Applied optics.

[23]  D. Malacara.  Optical Shop Testing , 1978 .

[24]  Song Zhang,et al.  GPU-assisted high-resolution, real-time 3-D shape measurement. , 2006, Optics express.

[25]  Song Zhang,et al.  Generic nonsinusoidal phase error correction for three-dimensional shape measurement using a digital video projector. , 2007, Applied optics.

[26]  Xiaolin Li,et al.  Multilevel quality-guided phase unwrapping algorithm for real-time three-dimensional shape reconstruction. , 2007, Applied optics.

[27]  David R Burton,et al.  Agglomerative clustering-based approach for two-dimensional phase unwrapping. , 2005, Applied optics.

[28]  Szymon Rusinkiewicz,et al.  Stripe boundary codes for real-time structured-light range scanning of moving objects , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[29]  Yazhu Chen,et al.  Flexible and accurate implementation of a binocular structured light system , 2008 .

[30]  Zhanyi Hu,et al.  Flexible method for structured light system calibration , 2008 .

[31]  R Cusack,et al.  Improved noise-immune phase-unwrapping algorithm. , 1995, Applied optics.

[32]  Song Zhang,et al.  Three-dimensional data merging using holoimage , 2008 .

[33]  Toshiyuki Yamada,et al.  Phase unwrapping by regions using least-squares approach , 1998 .

[34]  C. Werner,et al.  Satellite radar interferometry: Two-dimensional phase unwrapping , 1988 .

[35]  Ahmed M. Elgammal,et al.  High Resolution Acquisition, Learning and Transfer of Dynamic 3‐D Facial Expressions , 2004, Comput. Graph. Forum.

[36]  Tessa A. Hadlock,et al.  Novel 3-D video for quantification of facial movement , 2008, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[37]  Werner Jüptner,et al.  Accurate procedure for the calibration of a structured light system , 2004 .

[38]  Li Zhang,et al.  Spacetime faces: high resolution capture for modeling and animation , 2004, SIGGRAPH 2004.

[39]  Song Zhang,et al.  High-resolution, real-time three-dimensional shape measurement , 2006 .

[40]  Fu-Pen Chiang,et al.  Color-coded binary fringe projection technique for 3-D shape measurement , 2005 .

[41]  Martin J Graves,et al.  Branch cut surface placement for unwrapping of undersampled three-dimensional phase data: application to magnetic resonance imaging arterial flow mapping. , 2006, Applied optics.

[42]  Song Zhang,et al.  Three-dimensional shape measurement using a structured light system with dual cameras , 2008 .

[43]  Fu-Pen Chiang,et al.  High-speed 3-D shape measurement based on digital fringe projection , 2003 .

[44]  Dennis C. Ghiglia,et al.  Two-Dimensional Phase Unwrapping: Theory, Algorithms, and Software , 1998 .

[45]  Louis A. Romero,et al.  Minimum Lp-norm two-dimensional phase unwrapping , 1996 .

[46]  Qingying Hu,et al.  Calibration of a three-dimensional shape measurement system , 2003 .

[47]  Antonio Baldi.  Phase unwrapping by region growing. , 2003, Applied optics.

[48]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[49]  Jonathan Kofman,et al.  Two-step triangular-pattern phase-shifting method for three-dimensional object-shape measurement , 2007 .

[50]  Xu Han,et al.  On improving the accuracy of structured light systems , 2006, SPIE Optics East.

[51]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[52]  Peisen Huang,et al.  Microscopic phase-shifting profilometry based on digital micromirror device technology. , 2002, Applied optics.

[53]  Mitsuo Takeda,et al.  Two-wavelength Talbot effect and its application for three-dimensional step-height measurement. , 2006, Applied optics.

[54]  Peisen S. Huang,et al.  Phase error compensation for a 3-D shape measurement system based on the phase-shifting method , 2007 .

[55]  Peisen S. Huang,et al.  Absolute phase retrieval for 3D shape measurement by Fourier transform method , 2007, SPIE Optics East.

[56]  J. M. Huntley.  Noise-immune phase unwrapping algorithm. , 1989, Applied optics.

[57]  David P. Towers,et al.  Absolute fringe order calculation using optimised multi-frequency selection in full-field profilometry , 2005 .

[58]  J. R. Buckland,et al.  Unwrapping noisy phase maps by use of a minimum-cost-matching algorithm. , 1995, Applied optics.

[59]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[60]  C Guan,et al.  Composite structured light pattern for three-dimensional video. , 2003, Optics express.

[61]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[62]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  Song Zhang,et al.  Absolute phase-assisted three-dimensional data registration for a dual-camera structured light system. , 2008, Applied optics.

[64]  Francisco J. Cuevas,et al.  Depth object recovery using radial basis functions , 1999 .

[65]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..