3D shape measurement of objects with uncooperative surface by projection of aperiodic thermal patterns in simulation and experiment

Abstract. 3D shape measurement systems based on diffuse reflection of projected structured light are widely used. Unfortunately, this measurement principle does not work for uncooperative materials, i.e., materials with optical properties such as being glossy, transparent, absorbent, or translucent. Recently, it was shown that 3D reconstruction of an uncooperative object can be performed by a two-step process. In the first step, the object absorbs a projected thermal pattern. In the second step, after energy conversion, the object surface reemits a diffused thermal pattern according to Planck’s law. To achieve high 3D result qualities in short measurement times, projection parameters such as irradiance pattern and irradiation period must be optimized depending on optical and thermal material properties, e.g., complex spectral refractive index, thermal conductivity, specific heat capacity, or emissivity. Therefore, we have developed a simulation tool to describe the entire measurement process beginning with the projection unit, followed by the interaction of the irradiation with the measurement object, reemission of thermal radiation and recording unit, and finally the 3D reconstruction. In this contribution, we present our simulation tool, verify it with measurement results, and apply it to investigations of the influence of projection and material parameters on the 3D result quality.

[1]  Olivier Aubreton,et al.  Infrared system for 3D scanning of metallic surfaces , 2013, Machine Vision and Applications.

[2]  Peter Kühmstedt,et al.  Non-destructive 3D shape measurement of transparent and black objects with thermal fringes , 2016, Commercial + Scientific Sensing and Imaging.

[3]  Peter Kühmstedt,et al.  3D shape measurement by thermal fringe projection: optimization of infrared (IR) projection parameters , 2018, Commercial + Scientific Sensing and Imaging.

[4]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[5]  Peter Kühmstedt,et al.  3D shape measurement of glass and transparent plastics with a thermal 3D system in the mid-wave infrared , 2018, Commercial + Scientific Sensing and Imaging.

[6]  Susumu Hattori,et al.  Establishing a practical temperature standard by using a narrow-band radiation thermometer with a silicon detector , 1983 .

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  D. Lane The optical properties and laser irradiation of some common glasses , 1990 .

[9]  Andreas Tünnermann,et al.  GOBO projection for 3D measurements at highest frame rates: a performance analysis , 2018, Light: Science & Applications.

[10]  P. Albrecht,et al.  Stereo photogrammetry with improved spatial resolution , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[11]  Andreas Wolf,et al.  Long wave infrared 3D scanner , 2015, Sensing Technologies + Applications.

[12]  Peter Kühmstedt,et al.  3D shape measurement with thermal pattern projection , 2016 .

[13]  David Fofi,et al.  Review and comparison of non-conventional imaging systems for three-dimensional digitization of transparent objects , 2012, J. Electronic Imaging.

[14]  M. Fox Optical Properties of Solids , 2010 .

[15]  Peter Kühmstedt,et al.  3D shape from thermal patterns: investigation of projection parameters in simulation and experiment , 2019, Optical Metrology.

[16]  J. Lienhard A heat transfer textbook , 1981 .

[17]  Peter Kühmstedt,et al.  BICOS—An Algorithm for Fast Real-Time Correspondence Search for Statistical Pattern Projection-Based Active Stereo Sensors , 2019, Applied Sciences.

[18]  Peter Kühmstedt,et al.  Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement , 2014 .

[19]  Andreas Tünnermann,et al.  Theoretical considerations on aperiodic sinusoidal fringes in comparison to phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement. , 2015, Applied optics.

[20]  Kiriakos N. Kutulakos,et al.  Transparent and Specular Object Reconstruction , 2010, Comput. Graph. Forum.

[21]  Seungkyu Lee,et al.  Skewed stereo time-of-flight camera for translucent object imaging , 2015, Image Vis. Comput..

[22]  Jan Boehm,et al.  Close-Range Photogrammetry and 3D Imaging , 2013 .

[23]  Axel Wiegmann,et al.  Human face measurement by projecting bandlimited random patterns. , 2006, Optics express.

[24]  Olivier Aubreton,et al.  3-D Scanning of Nonopaque Objects by Means of Imaging Emitted Structured Infrared Patterns , 2010, IEEE Transactions on Instrumentation and Measurement.

[25]  Andreas Tünnermann,et al.  Experimental comparison of aperiodic sinusoidal fringes and phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement , 2016 .

[26]  F. Mériaudeau,et al.  Scanning from heating: 3D shape estimation of transparent objects from local surface heating. , 2009, Optics express.