Reconstructing Shape and Appearance of Thin Film Objects with Hyper Spectral Sensor

Modeling the shape and appearance of a thin film object has promising applications such as heritage-modeling and industrial inspections. In the same time, such modeling is a frontier of computer vision and contains various challenging issues to be solved. In particular, thin film colors show iridescence along the view and lighting directions and how to acquire and formalize the spectral iridescence for shape estimation. This paper aims to model the shapes and appearances of thin film objects from measured reflectance spectra. Thin film reflectance is represented by the incident angle on the object surface, the refractive index and the film thickness. First, we estimate the incident angle of a surface patch on a thin film based on monotonically increasing peak intensities. Then, we apply a characteristics strip expansion method to the peak intensity for estimating the surface normal of the patch. Based on this shape estimation, we estimate refractive index and film thickness from iridescence variance. We experimentally evaluate the accuracy of the estimated shape and estimated parameters. We also demonstrate to reconstruct appearances based on the shape and parameters.

[1]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[2]  Kazufumi Kaneda,et al.  Rendering iridescent colors appearing on natural objects , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[3]  Ko Nishino,et al.  Shape and Reflectance from Natural Illumination , 2012, ECCV.

[4]  Berthold K. P. Horn.  A problem in computer vision , 1975 .

[5]  Karl Wilh. Meissner.  Interference Spectroscopy. Part II , 1941 .

[6]  R. Azzam,et al.  Ellipsometry and polarized light , 1977 .

[7]  Berthold K. P. Horn.  Orienting silicon integrated circuit chips for lead bonding , 1975 .

[8]  Katsushi Ikeuchi,et al.  BRDF Estimation of Structural Color Object by Using Hyper Spectral Image , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[9]  Mark S. Drew,et al.  Deriving Spectra from Colors and Rendering Light Interference , 1999, IEEE Computer Graphics and Applications.

[10]  K. Kitagawa,et al.  Transparent film thickness measurement by three-wavelength interference method: An extended application of Global Model Fitting algorithm , 2012, 2012 9th France-Japan & 7th Europe-Asia Congress on Mechatronics (MECATRONICS) / 13th Int'l Workshop on Research and Education in Mechatronics (REM).

[11]  Kei Iwasaki,et al.  Real-time rendering of soap bubbles taking into account light interference , 2004, Proceedings Computer Graphics International, 2004..

[12]  Ramesh Raskar,et al.  Reflectance model for diffraction , 2012, TOGS.

[13]  Kiriakos N. Kutulakos,et al.  Reconstructing the Surface of Inhomogeneous Transparent Scenes by Scatter-Trace Photography , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Christian Wöhler,et al.  An introduction to image-based 3D surface reconstruction and a survey of photometric stereo methods , 2011 .

[15]  Katsuichi Kitagawa,et al.  Thin-film thickness profile measurement by three-wavelength interference color analysis. , 2013, Applied optics.

[16]  Kazufumi Kaneda,et al.  An accurate illumination model for objects coated with multilayer films , 2001, Comput. Graph..

[17]  Katsushi Ikeuchi,et al.  Estimating optical properties of layered surfaces using the spider model , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  George H. Seward.  Basic Physical Optics , 2010 .

[19]  木下 修一,et al.  Structural colors in the realm of nature , 2008 .

[20]  Francisco J. Serón,et al.  Physically-based simulation of rainbows , 2012, TOGS.

[21]  Mark S. Drew,et al.  Rendering Iridescent Colors of Optical Disks , 2000, Rendering Techniques.