A state of the art in structured light patterns for surface profilometry

Shape reconstruction using coded structured light is considered one of the most reliable techniques to recover object surfaces. Having a calibrated projector-camera pair, a light pattern is projected onto the scene and imaged by the camera. Correspondences between projected and recovered patterns are found and used to extract 3D surface information. This paper presents an up-to-date review and a new classification of the existing techniques. Some of these techniques have been implemented and compared, obtaining both qualitative and quantitative results. The advantages and drawbacks of the different patterns and their potentials are discussed.

[1]  V. Srinivasan,et al.  Automated phase-measuring profilometry: a phase mapping approach. , 1985, Applied optics.

[2]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Joris Vanherzeele,et al.  Fourier fringe processing using a regressive Fourier-transform technique , 2005 .

[4]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[5]  C Guan,et al.  Composite structured light pattern for three-dimensional video. , 2003, Optics express.

[6]  Minoru Maruyama,et al.  Range Sensing by Projecting Multiple Slits with Random Cuts , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[8]  Kim L. Boyer,et al.  Color-Encoded Structured Light for Rapid Active Ranging , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Tuvi Etzion,et al.  Constructions for perfect maps and pseudorandom arrays , 1988, IEEE Trans. Inf. Theory.

[10]  W CapsonDavid,et al.  Surface profile measurement using color fringe projection , 1991 .

[11]  Cengizhan Ozturk,et al.  Structured Light Using Pseudorandom Codes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Guangjun Zhang,et al.  Large 3D free surface measurement using a mobile coded light-based stereo vision system , 2006 .

[13]  Luc Van Gool,et al.  Real-time range acquisition by adaptive structured light , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Christophe Collewet,et al.  An approach to visual servoing based on coded light , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[15]  Akira Ishii,et al.  A three-level checkerboard pattern (TCP) projection method for curved surface measurement , 1995, Pattern Recognit..

[16]  Xianyu Su,et al.  Study on Fourier transforms profilometry based on bi-color projecting , 2005 .

[17]  David W. Capson,et al.  Surface profile measurement using color fringe projection , 1991, Machine Vision and Applications.

[18]  H. Fredricksen.  A Survey of Full Length Nonlinear Shift Register Cycle Algorithms , 1982 .

[19]  Tokuo Tsuji,et al.  High-speed 3D image acquisition using coded structured light projection , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Joaquim Salvi,et al.  Efficient and Low-Cost 3D Structured Light System Based on a Modified Number-Theoretic Approach , 2009, EURASIP J. Adv. Signal Process..

[21]  Ja-Ling Wu,et al.  Range data acquisition using color structured lighting and stereo vision , 1997, Image Vis. Comput..

[22]  Eryi Hu,et al.  Surface profile measurement of moving objects by using an improved π phase-shifting Fourier transform profilometry , 2009 .

[23]  Yan Tang,et al.  Method of choosing the adaptive level of discrete wavelet decomposition to eliminate zero component , 2009 .

[24]  A. Maurel,et al.  Global measurement of water waves by Fourier transform profilometry , 2009 .

[25]  T. Kanade,et al.  A Method of Time-Coded Parallel Planes of Light for Depth Measurement , 1981 .

[26]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[27]  Dario Ambrosini,et al.  Contouring of artwork surface by fringe projection and FFT analysis , 2000 .

[28]  Pierre Graebling,et al.  Design of a Monochromatic Pattern for a Robust Structured Light Coding , 2007, 2007 IEEE International Conference on Image Processing.

[29]  Frank Forster.  A High-Resolution and High Accuracy Real-Time 3D Sensor Based on Structured Light , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[30]  Johji Tajima,et al.  3-D data acquisition by Rainbow Range Finder , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[31]  Peter Eisert,et al.  Adaptive color classification for structured light systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[32]  David R. Burton,et al.  Eliminating the zero spectrum in Fourier transform profilometry using a two-dimensional continuous wavelet transform , 2006 .

[33]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[34]  Jonathan Kofman,et al.  Two-step triangular-pattern phase-shifting method for three-dimensional object-shape measurement , 2007 .

[35]  M.A. Tehrani,et al.  A New Approach to 3D Modeling Using Structured Light Pattern , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[36]  John N. Carter,et al.  Colour-encoded structured light for digitisation of real-time 3D data , 1992 .

[37]  N. Ono,et al.  Real-time 3D imager based on spatio-temporal phase unwrapping , 2004, SICE 2004 Annual Conference.

[38]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Yu. N. Solodkin,et al.  Automatic processing of fringe patterns in integer interferometers , 1991 .

[40]  X. Su,et al.  Improved Fourier transform profilometry for the automatic measurement of 3D object shapes , 1990 .

[41]  F. MacWilliams,et al.  Pseudo-random sequences and arrays , 1976, Proceedings of the IEEE.

[42]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[43]  Lu-Shen Wu,et al.  Research and development of fringe projection-based methods in 3D shape reconstruction , 2006 .

[44]  Shojiro Sakata,et al.  Reconstruction Of Surfaces Of 3-D Objects By M-array Pattern Projection Method , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[45]  Barry Mazur,et al.  Algebraic Numbers By , 2005 .

[46]  Jeffrey L. Posdamer,et al.  Surface measurement by space-encoded projected beam systems , 1982, Comput. Graph. Image Process..

[47]  T. R. Judge,et al.  A review of phase unwrapping techniques in fringe analysis , 1994 .

[48]  Robert A. Hummel,et al.  Experiments with the intensity ratio depth sensor , 1985, Comput. Vis. Graph. Image Process..

[49]  Fu-Pen Chiang,et al.  Trapezoidal phase-shifting method for three-dimensional shape measurement , 2005 .

[50]  Paul M. Griffin,et al.  Generation of uniquely encoded light patterns for range data acquisition , 1992, Pattern Recognit..

[51]  Peisen S. Huang,et al.  Novel method for structured light system calibration , 2006 .

[52]  Xianyu Su,et al.  Two-dimensional Fourier transform profilometry for the automatic measurement of three-dimensional object shapes , 1995 .

[53]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[54]  Joaquim Salvi,et al.  A new optimised De Bruijn coding strategy for structured light patterns , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[55]  Christophe Collewet,et al.  Optimised De Bruijn patterns for one-shot shape acquisition , 2005, Image Vis. Comput..

[56]  X. Su,et al.  Fourier transform profilometry based on composite structured light pattern , 2007 .

[57]  Giovanna Sansoni,et al.  Calibration and performance evaluation of a 3-D imaging sensor based on the projection of structured light , 2000, IEEE Trans. Instrum. Meas..

[58]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[59]  Marc Pollefeys,et al.  IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops, 2008 , 2008, CVPR 2008.

[60]  Xianyu Su,et al.  Fourier transform profilometry:: a review , 2001 .

[61]  Sai Siva Gorthi,et al.  A new approach for simple and rapid shape measurement of objects with surface discontinuities , 2005, SPIE Optical Metrology.

[62]  Yasushi Yagi,et al.  Dynamic scene shape reconstruction using a single structured light pattern , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[63]  Xianyu Su,et al.  Method for eliminating zero spectrum in Fourier transform profilometry , 2005 .

[64]  Fiona Berryman,et al.  A new system for measuring three-dimensional back shape in scoliosis , 2008, European Spine Journal.

[65]  Antonio Baldi,et al.  On the performance of some unwrapping algorithms , 2002 .

[66]  Armin Gruen,et al.  Videometrics and Optical Methods for 3d Shape Measurement , 2000 .