Shape from Specular Flow with Near-Field Environment Motion Field

Reconstruction of curved, mirror-like surfaces in unknown lighting environments is a challenging problem. One well-known solution is the ‘shape from specular flow’ approach, which assumes far-field environment illumination. The assumption makes it impractical for the case of near-field environment. We show that with the presence of unknown nearby objects, the observed specular flow can be related to the surface shape and the environment motion through a group of nonlinear partial differential equations. This PDE system can be converted into a canonical form of hyperbolic equation. Stable, unique solution of such equation exists when the Cauchy boundary condition is given. Numerical methods are implemented to solve the PDE system for the case of translating near-field environment motions. Both the curved surface and the near-field environment are recovered. Experiments on both real and synthetic data support the proposed method.

[1]  Pau Gargallo,et al.  General Specular Surface Triangulation , 2006, ACCV.

[2]  Ohad Ben-Shahar,et al.  A linear formulation of shape from specular flow , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  Michael J. Black,et al.  Specular Flow and the Recovery of Surface Structure , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Min Chen,et al.  Local Shape from Mirror Reflections , 2005, International Journal of Computer Vision.

[6]  Gang Xu,et al.  Dense 3D Reconstruction of Specular and Transparent Objects Using Stereo Cameras and Phase-Shift Method , 2007, ACCV.

[7]  Ohad Ben-Shahar,et al.  Toward a Theory of Shape from Specular Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Ohad Ben-Shahar,et al.  Dense specular shape from multiple specular flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Zhenwen Dai,et al.  Specular Surface Recovery from Reflections of a Planar Pattern Undergoing an Unknown Pure Translation , 2010, ACCV.

[10]  P. Giblin,et al.  Curves and singularities : a geometrical introduction to singularity theory , 1992 .

[11]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[12]  Ohad Ben-Shahar,et al.  Shape from Specular Flow , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ohad Ben-Shahar,et al.  Shape from specular flow: Is one flow enough? , 2011, CVPR 2011.

[14]  Aswin C. Sankaranarayanan,et al.  Specular surface reconstruction from sparse reflection correspondences , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Lee E. Weiss,et al.  Specular surface inspection using structured highlight and Gaussian images , 1990, IEEE Trans. Robotics Autom..

[16]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Peter F. Sturm,et al.  Voxel carving for specular surfaces , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Yasushi Yagi Computer Vision - ACCV 2007, 8th Asian Conference on Computer Vision, Tokyo, Japan, November 18-22, 2007, Proceedings, Part I , 2007, ACCV.

[19]  Radim Sára,et al.  A Weak Structure Model for Regular Pattern Recognition Applied to Facade Images , 2010, ACCV.

[20]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image Vis. Comput..

[21]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[22]  A. Heyden,et al.  A variational analysis of shape from specularities using sparse data , 2004 .

[23]  D. B. Davis,et al.  Intel Corp. , 1993 .

[24]  Shree K. Nayar,et al.  Computer Vision - ACCV 2006, 7th Asian Conference on Computer Vision, Hyderabad, India, January 13-16, 2006, Proceedings, Part I , 2006, ACCV.

[25]  Lee E. Weiss,et al.  Structured Highlight Inspection of Specular Surfaces , 1988, IEEE Trans. Pattern Anal. Mach. Intell..