Variational multiframe stereo in the presence of specular reflections

We consider the problem of estimating the surface of an object from a calibrated set of views under the assumption that the reflectance of the object is non-Lambertian. In particular, we consider the case when the object presents sharp specular reflections. We pose the problem within a variational framework and use fast numerical techniques to approach the local minimum of a regularized cost functional.

[1]  Andrew Blake,et al.  Detecting Specular Reflections Using Lambertian Constraints , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[2]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[4]  Shree K. Nayar,et al.  Removal of specularities using color and polarization , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Lester A. Gerhardt,et al.  Three-dimensional vision , 1992 .

[7]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[8]  A. Rau Variational Principles , 2021, Classical Mechanics.

[9]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[10]  Olivier D. Faugeras,et al.  Variational principles, surface evolution, PDEs, level set methods, and the stereo problem , 1998, IEEE Trans. Image Process..

[11]  Shree K. Nayar,et al.  Stereo in the presence of specular reflection , 1995, Proceedings of IEEE International Conference on Computer Vision.

[12]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.