Optimised photometric stereo via non-convex variational minimisation

Estimating the shape and appearance of a three dimensional object from flat images is a challenging research topic that is still actively pursued. Among the various techniques available, Photometric Stereo is known to provide very accurate local shape recovery, in terms of surface normals. In this work, we propose to minimise non-convex variational models for Photometric Stereo that recover the depth information directly. We suggest an approach based on a novel optimisation scheme for non-convex cost functions. Experiments show that our strategy achieves more accurate results than competing approaches.

[1]  Matthew Harker,et al.  Regularized Reconstruction of a Surface from its Measured Gradient Field , 2013, Journal of Mathematical Imaging and Vision.

[2]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[3]  Alfred M. Bruckstein,et al.  Near Field Photometric Stereo with Point Light Sources , 2014, SIAM J. Imaging Sci..

[4]  Zhe Wu,et al.  A Benchmark Dataset and Evaluation for Non-Lambertian and Uncalibrated Photometric Stereo , 2019, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jean-Denis Durou,et al.  A L^1 -TV Algorithm for Robust Perspective Photometric Stereo with Spatially-Varying Lightings , 2015, SSVM.

[6]  Jan Chabrowski,et al.  On variational approach to photometric stereo , 1993 .

[7]  William A. P. Smith,et al.  Height from photometric ratio with model-based light source selection , 2016, Comput. Vis. Image Underst..

[8]  D. Hinkley.  On the ratio of two correlated normal random variables , 1969 .

[9]  Rama Chellappa,et al.  Enforcing integrability by error correction using l1-minimization , 2009, CVPR.

[10]  Peter Ochs,et al.  Unifying abstract inexact convergence theorems for descent methods and block coordinate variable metric iPiano , 2016 .

[11]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[12]  Paolo Favaro,et al.  Uncalibrated Near-Light Photometric Stereo , 2014, BMVC.

[13]  Michael Breuß,et al.  An Improved Eikonal Method for Surface Normal Integration , 2015, GCPR.

[14]  Yaser Sheikh,et al.  Photogeometric Scene Flow for High-Detail Dynamic 3D Reconstruction , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Marc Pollefeys,et al.  Variational Regularization and Fusion of Surface Normal Maps , 2014, 2014 2nd International Conference on 3D Vision.

[16]  Yongtian Wang,et al.  Robust Photometric Stereo via Low-Rank Matrix Completion and Recovery , 2010, ACCV.

[17]  Alessio Del Bue,et al.  Direct Differential Photometric Stereo Shape Recovery of Diffuse and Specular Surfaces , 2016, Journal of Mathematical Imaging and Vision.

[18]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[19]  James J. Clark.  Active photometric stereo , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[21]  Jean-Denis Durou,et al.  Unbiased Photometric Stereo for Colored Surfaces: A Variational Approach , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jean-Denis Durou,et al.  Integrating the Normal Field of a Surface in the Presence of Discontinuities , 2009, EMMCVPR.

[23]  D.S.G. Pollock,et al.  Tensor products and matrix differential calculus , 1985 .

[24]  Michael Breuß,et al.  Generalised Perspective Shape from Shading with Oren-Nayar Reflectance , 2013, BMVC.

[25]  Yvain Quéau,et al.  Unifying diffuse and specular reflections for the photometric stereo problem , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[26]  J. Magnus,et al.  Matrix differential calculus with applications to simple, Hadamard, and Kronecker products. , 1985 .

[27]  Thomas Brox,et al.  iPiano: Inertial Proximal Algorithm for Nonconvex Optimization , 2014, SIAM J. Imaging Sci..

[28]  J. Moreau.  Proximité et dualité dans un espace hilbertien , 1965 .

[29]  Kiyoharu Aizawa,et al.  Photometric Stereo Using Sparse Bayesian Regression for General Diffuse Surfaces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Tien-Tsin Wong,et al.  Dense Photometric Stereo: A Markov Random Field Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.