Uncalibrated Deflectometry with a Mobile Device on Extended Specular Surfaces

We introduce a system and methods for the three-dimensional measurement of extended specular surfaces with high surface normal variations. Our system consists only of a mobile hand held device and exploits screen and front camera for Deflectometry-based surface measurements. We demonstrate high quality measurements without the need for an offline calibration procedure. In addition, we develop a multi-view technique to compensate for the small screen of a mobile device so that large surfaces can be densely reconstructed in their entirety. This work is a first step towards developing a self-calibrating Deflectometry procedure capable of taking 3D surface measurements of specular objects in the wild and accessible to users with little to no technical imaging experience.

[1]  Hans-Peter Seidel,et al.  Mesostructure from Specularity , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Jingyi Yu,et al.  Recovering specular surfaces using curved line images , 2009, CVPR.

[3]  Hans-Peter Seidel,et al.  3D acquisition of mirroring objects using striped patterns , 2005, Graph. Model..

[4]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Florian Willomitzer,et al.  Hand-guided 3D surface acquisition by combining simple light sectioning with real-time algorithms , 2014, ArXiv.

[6]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[7]  Markus C. Knauer,et al.  Phase measuring deflectometry: a new approach to measure specular free-form surfaces , 2004, SPIE Photonics Europe.

[8]  Helmut Fischer,et al.  New electro-optical mixing and correlating sensor: facilities and applications of the photonic mixer device (PMD) , 1997, Other Conferences.

[9]  Pieter Peers,et al.  Mobile Surface Reflectometry , 2016, Comput. Graph. Forum.

[10]  Christian Faber,et al.  Deflectometric Self-Calibration for arbitrary specular surfaces , 2011 .

[11]  Lee E. Weiss,et al.  Specular surface inspection using structured highlight and Gaussian images , 1990, IEEE Trans. Robotics Autom..

[12]  Paul Graham,et al.  Acquiring reflectance and shape from continuous spherical harmonic illumination , 2013, ACM Trans. Graph..

[13]  James H. Burge,et al.  Deflectometry using portable devices , 2015 .

[14]  Peter F. Sturm,et al.  Voxel carving for specular surfaces , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Can Chen,et al.  3D reconstruction of mirror-type objects using efficient ray coding , 2016, 2016 IEEE International Conference on Computational Photography (ICCP).

[16]  Eckart Uhlmann,et al.  Deflectometry for Ultra-Precision Machining - Measuring without Rechucking , 2011 .

[17]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yuankun Liu,et al.  Fast and accurate deflectometry with crossed fringes , 2014, 1404.5727.

[19]  Florian Willomitzer,et al.  Flying Triangulation - a Motion-Robust Optical 3D Sensor for the Real-Time Shape Acquisition of Complex Objects , 2013 .

[20]  Lee E. Weiss,et al.  Structured Highlight Inspection of Specular Surfaces , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Svenja Ettl,et al.  Deflectometry vs. interferometry , 2013, Optical Metrology.

[22]  Marc Pollefeys,et al.  Real-World Normal Map Capture for Nearly Flat Reflective Surfaces , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Sid Perkins.  New app reveals the hidden landscapes within Georgia O’Keeffe’s paintings , 2019, Science.

[24]  Peter Hedman,et al.  Multi-view Reconstruction of Highly Specular Surfaces in Uncontrolled Environments , 2015, 2015 International Conference on 3D Vision.

[25]  Christian Faber,et al.  Deflectometry challenges interferometry: the competition gets tougher! , 2012, Other Conferences.