Linear Depth Estimation from an Uncalibrated, Monocular Polarisation Image

We present a method for estimating surface height directly from a single polarisation image simply by solving a large, sparse system of linear equations. To do so, we show how to express polarisation constraints as equations that are linear in the unknown depth. The ambiguity in the surface normal azimuth angle is resolved globally when the optimal surface height is reconstructed. Our method is applicable to objects with uniform albedo exhibiting diffuse and specular reflectance. We extend it to an uncalibrated scenario by demonstrating that the illumination (point source or first/second order spherical harmonics) can be estimated from the polarisation image, up to a binary convex/concave ambiguity. We believe that our method is the first monocular, passive shape-from-x technique that enables well-posed depth estimation with only a single, uncalibrated illumination condition. We present results on glossy objects, including in uncontrolled, outdoor illumination.

[1]  Gary A. Atkinson,et al.  Recovery of surface orientation from diffuse polarization , 2006, IEEE Transactions on Image Processing.

[2]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Sehoon Ha,et al.  Iterative Training of Dynamic Skills Inspired by Human Coaching Techniques , 2014, ACM Trans. Graph..

[4]  Jannik Boll Nielsen,et al.  On optimal, minimal BRDF sampling for reflectance acquisition , 2015, ACM Trans. Graph..

[5]  Stefan Rahmann,et al.  Reconstruction of specular surfaces using polarization imaging , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Yoav Y. Schechner.  Self-Calibrating Imaging Polarimetry , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[7]  Fabrice Meriaudeau,et al.  Polarization imaging applied to 3D reconstruction of specular metallic surfaces , 2005, IS&T/SPIE Electronic Imaging.

[8]  Lawrence B. Wolff,et al.  Polarization vision: a new sensory approach to image understanding , 1997, Image Vis. Comput..

[9]  Rin-ichiro Taniguchi,et al.  Shape and light directions from shading and polarization , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Alessio Del Bue,et al.  Direct Differential Photometric Stereo Shape Recovery of Diffuse and Specular Surfaces , 2016, Journal of Mathematical Imaging and Vision.

[11]  M. Krejsa,et al.  Structural Mechanics , 2001 .

[12]  Cong Phuoc Huynh,et al.  Shape and refractive index recovery from single-view polarisation images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Edwin R. Hancock,et al.  Surface Reconstruction Using Polarization and Photometric Stereo , 2007, CAIP.

[15]  Edwin R. Hancock,et al.  Shape Estimation Using Polarization and Shading from Two Views , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[17]  Aly A. Farag,et al.  Direct method for shape recovery from polarization and shading , 2012, 2012 19th IEEE International Conference on Image Processing.

[18]  Cong Phuoc Huynh,et al.  Shape and Refractive Index from Single-View Spectro-Polarimetric Images , 2012, International Journal of Computer Vision.

[19]  Stephen P. Boyd,et al.  Disciplined Convex Programming , 2006 .

[20]  Szymon Rusinkiewicz,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, ACM Trans. Graph..

[21]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[22]  Ramesh Raskar,et al.  Polarized 3D: High-Quality Depth Sensing with Polarization Cues , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Katsushi Ikeuchi,et al.  Polarization-based inverse rendering from a single view , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  O. Drbohlav,et al.  Unambiguous determination of shape from photometric stereo with unknown light sources , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Cong Phuoc Huynh,et al.  Imaging Spectroscopy for Scene Analysis , 2012, Advances in Computer Vision and Pattern Recognition.

[27]  N. T. Hoai-Phuong,et al.  Optimization under Composite Monotonic Constraints and Constrained Optimization over the Efficient Set , 2006 .