Shape from specular flow: Is one flow enough?

Specular flow is the motion field induced on the image plane by the movement of points reflected by a curved, mirror-like surface. This flow provides information about surface shape, and when the camera and surface move as a fixed pair, shape can be recovered by solving linear differential equations along integral curves of flow. Previous analysis has shown that two distinct motions (i.e., two flow fields) are generally sufficient to guarantee a unique solution without externally-provided initial conditions. In this work, we show that we can often succeed with only one flow. The key idea is to exploit the fact that smooth surfaces induce integrability constraints on the surface normal field. We show that this induces a new differential equation that facilitates the propagation of shape information between integral curves of flow, and that combining this equation with known methods often permits the recovery of unique shape from a single specular flow given only a single seed point.

[1]  Ohad Ben-Shahar,et al.  Toward a Theory of Shape from Specular Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Ohad Ben-Shahar,et al.  Dense specular shape from multiple specular flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Leonard McMillan,et al.  Image-based rendering: A new interface between computer vision and computer graphics , 1999, COMG.

[4]  P. Giblin,et al.  Curves and singularities : a geometrical introduction to singularity theory , 1992 .

[5]  J William,et al.  IEEE Computer Graphics and Applications , 2019, Computer.

[6]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[7]  Jiang Yu Zheng,et al.  Acquiring a Complete 3D Model from Specular Motion under the Illumination of Circular-Shaped Light Sources , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  P. Sturm,et al.  Towards Generic Self-Calibration of Central Cameras , 2005 .

[9]  Ohad Ben-Shahar,et al.  The Perceptual Organization of Texture Flow: A Contextual Inference Approach , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  David Zeltzer,et al.  Proceedings : 1997 Symposium on Interactive 3D Graphics, Providence, R. I., April 27-30, 1997 , 1997 .

[11]  P. Giblin,et al.  Curves and Singularities , 1984 .

[12]  Ohad Ben-Shahar,et al.  A linear formulation of shape from specular flow , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[14]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[15]  Ferran Espuny,et al.  Generic Self-calibration of Central Cameras from Two Rotational Flows , 2010, International Journal of Computer Vision.

[16]  Ohad Ben-Shahar,et al.  Toward Shape from a Single Specular Flow , 2011 .

[17]  Ohad Ben-Shahar,et al.  Shape from Specular Flow , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Etienne Grossmann,et al.  Non-parametric self-calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[19]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[20]  M. Longuet-Higgins Reflection and Refraction at a Random Moving Surface. I. Pattern and Paths of Specular Points , 1960 .

[21]  Michael J. Black,et al.  Specular Flow and the Recovery of Surface Structure , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Aswin C. Sankaranarayanan,et al.  Specular surface reconstruction from sparse reflection correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image Vis. Comput..

[24]  C. Dyer,et al.  Dynamic shading, motion parallax and qualitative shape , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[25]  A Blake,et al.  Shape from specularities: computation and psychophysics. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.