Generic design methodology for the development of three-dimensional structured-light sensory systems for measuring complex objects

Abstract. Structured-light (SL) techniques are emerging as popular noncontact approaches for obtaining three-dimensional (3-D) measurements of complex objects for real-time applications in manufacturing, bioengineering, and robotics. The performance of SL systems is determined by the emitting (i.e., projector) and capturing (i.e., camera) hardware components and the triangulation configuration between them and an object of interest. A generic design methodology is presented to determine optimal triangulation configurations for SL systems. These optimal configurations are determined with respect to a set of performance metrics: (1) minimizing the 3-D reconstruction errors, (2) maximizing the pixel-to-pixel correspondence between the projector and camera, and (3) maximizing the dispersion of the measured 3-D points within a measurement volume, while satisfying design constraints based on hardware and user-defined specifications. The proposed methodology utilizes a 3-D geometric triangulation model based on ray-tracing geometry and pin-hole models for the projector and camera. Using the methodology, a set of optimal system configurations can be determined for a given set of hardware components. The design methodology was applied to a real-time SL system for surface profiling of complex objects. Experiments were conducted with an optimal sensor configuration and its performance verified with respect to a nonoptimal hardware configuration.

[1]  Chern-Sheng Lin,et al.  Measurement method of three-dimensional profiles of small lens with gratings projection and a flexible compensation system , 2011, Expert Syst. Appl..

[2]  G. Sansoni,et al.  Three-dimensional imaging based on Gray-code light projection: characterization of the measuring algorithm and development of a measuring system for industrial applications. , 1997, Applied optics.

[3]  Ashok Veeraraghavan,et al.  A Practical Approach to 3D Scanning in the Presence of Interreflections, Subsurface Scattering and Defocus , 2013, International Journal of Computer Vision.

[4]  Guang-Zhong Yang,et al.  Spectrally encoded fiber-based structured lighting probe for intraoperative 3D imaging , 2011, Biomedical optics express.

[5]  Liang-Chia Chen,et al.  Fourier transform profilometry (FTP) using an innovative band-pass filter for accurate 3-D surface reconstruction , 2010 .

[6]  Kevin L. Moore,et al.  Rational Radial Distortion Models of Camera Lenses with Analytical Solution for Distortion Correction , 2004, Int. J. Inf. Acquis..

[7]  Joachim Hertzberg,et al.  Three-dimensional mapping with time-of-flight cameras , 2009 .

[8]  Joaquim Salvi,et al.  A new optimised De Bruijn coding strategy for structured light patterns , 2004, ICPR 2004.

[9]  Jens Guehring,et al.  Dense 3D surface acquisition by structured light using off-the-shelf components , 2000, IS&T/SPIE Electronic Imaging.

[10]  Joaquim Salvi,et al.  ' s personal copy Efficient multiple phase shift patterns for dense 3 D acquisition in structured light scanning , 2010 .

[11]  Song Zhang,et al.  High-resolution, real-time 3D imaging with fringe analysis , 2010, Journal of Real-Time Image Processing.

[12]  Zhaoyang Wang,et al.  Three-dimensional shape measurement with an arbitrarily arranged fringe projection profilometry system. , 2007, Optics letters.

[13]  Tao Peng,et al.  Model and Algorithms for Point Cloud Construction Using Digital Projection Patterns , 2007, J. Comput. Inf. Sci. Eng..

[14]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[15]  Tao Peng,et al.  Algorithms and models for 3-D shape measurement using digital fringe projections , 2007 .

[16]  Malgorzata Kujawinska,et al.  Digital fringe projection system for large-volume 360-deg shape measurement , 2002 .

[17]  Goldie Nejat,et al.  An active light sensory system for 3D mapping of unknown cluttered environments , 2010, 2010 IEEE International Conference on Automation Science and Engineering.

[18]  Luís N. Vicente,et al.  Direct Multisearch for Multiobjective Optimization , 2011, SIAM J. Optim..

[19]  Yajun Wang,et al.  Optimal fringe angle selection for digital fringe projection technique. , 2013, Applied optics.

[20]  Werner Jüptner,et al.  Accurate procedure for the calibration of a structured light system , 2004 .

[21]  Song Zhang,et al.  High-resolution, real-time three-dimensional shape measurement , 2006 .

[22]  Yannick Caulier.  Inspection of complex surfaces by means of structured light patterns. , 2010, Optics express.

[23]  Kun Zhang,et al.  Nonlinear image restoration with adaptive anisotropic regularizing operator , 2006 .

[24]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  G. W. Milligan,et al.  An examination of procedures for determining the number of clusters in a data set , 1985 .

[26]  Christian Bräuer-Burchardt.  A New Methodology for Determination and Correction of Lens Distortion in 3D Measuring Systems Using Fringe Projection , 2005, DAGM-Symposium.

[27]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[28]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[29]  Jing Xu,et al.  Rapid 3D surface profile measurement of industrial parts using two-level structured light patterns , 2011 .

[30]  Guangxue Yue,et al.  The Mathematical Model and Applications of Coded Structured Light System for Object Detecting , 2009, J. Comput..

[31]  Ming-June Tsai,et al.  Development of a high-precision surface metrology system using structured light projection , 2005 .

[32]  Chenggen Quan,et al.  Microscopic surface contouring by fringe projection method , 2002 .

[33]  Giovanna Sansoni,et al.  Three-dimensional optical measurements and reverse engineering for automotive applications , 2004 .

[34]  Wenjing Chen,et al.  Improved Fourier-transform profilometry. , 2007, Applied optics.

[35]  G. Nejat,et al.  3-D Active Sensing in Time-Critical Urban Search and Rescue Missions , 2012, IEEE/ASME Transactions on Mechatronics.

[36]  Seokbae Son,et al.  Automated laser scanning system for reverse engineering and inspection , 2002 .

[37]  X. Su,et al.  Improved Fourier transform profilometry for the automatic measurement of 3D object shapes , 1990 .

[38]  Giovanna Sansoni,et al.  State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation , 2009, Sensors.

[39]  Fu-Pen Chiang,et al.  Trapezoidal phase-shifting method for three-dimensional shape measurement , 2005 .

[40]  François Blais.  Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[41]  Peisen S. Huang,et al.  Novel method for structured light system calibration , 2006 .

[42]  Fu-Pen Chiang,et al.  High-speed 3-D shape measurement based on digital fringe projection , 2003 .

[43]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[44]  Jonathan Kofman,et al.  Lens distortion calibration by explicit straight-line to distorted-line geometric mapping , 2004, SPIE Optics East.

[45]  Pierre Graebling,et al.  Design of a Monochromatic Pattern for a Robust Structured Light Coding , 2007, 2007 IEEE International Conference on Image Processing.

[46]  Johji Tajima,et al.  3-D data acquisition by Rainbow Range Finder , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[47]  Dan Zeng,et al.  Model and error analysis for coded structured light measurement system , 2010 .

[48]  Lin Wu,et al.  3D Detection and Reconstruction of Worn Parts for Flexible Remanufacture , 2012 .

[49]  Yuan-Fang Wang,et al.  Error analysis of 3D shape construction from structured lighting , 1996, Pattern Recognit..

[50]  Jorge Santolaria,et al.  A stereo-vision system to automate the manufacture of a semitrailer chassis , 2013 .

[51]  Liang-Chia Chen,et al.  High Accuracy Confocal Full-Field 3-D Surface Profilometry for Micro Lenses Using a Digital Fringe Projection Strategy , 2007 .

[52]  Michalis Vazirgiannis,et al.  c ○ 2001 Kluwer Academic Publishers. Manufactured in The Netherlands. On Clustering Validation Techniques , 2022 .

[53]  Roger Mohr,et al.  Optimal camera placement for accurate reconstruction , 2002, Pattern Recognit..