A Theory of Specular Surface Geometry

A theoretical framework is introduced for the perception of specular surface geometry. When an observer moves in three-dimensional space, real scene features such as surface markings remain stationary with respect to the surfaces they belong to. In contrast, a virtual feature which is the specular reflection of a real feature, travels on the surface. Based on the notion of caustics, a feature classification algorithm is developed that distinguishes real and virtual features from their image trajectories that result from observer motion. Next, using support functions of curves, a closed-form relation is derived between the image trajectory of a virtual feature and the geometry of the specular surface it travels on. It is shown that, in the 2D case, where camera motion and the surface profile are coplanar, the profile is uniquely recovered by tracking just two unknown virtual features. Finally, these results are generalized to the case of arbitrary 3D surface profiles that are traveled by virtual features when camera motion is not confined to a plane. This generalization includes a number of mathematical results that substantially enhance the present understanding of specular surface geometry. An algorithm is developed that uniquely recovers 3D surface profiles using a single virtual feature tracked from the occluding boundary of the object. All theoretical derivations and proposed algorithms are substantiated by experiments.

[1]  Thomas O. Binford,et al.  Local shape from specularity , 1988, Comput. Vis. Graph. Image Process..

[2]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[3]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  S. Ullman.  On visual detection of light sources , 1976, Biological Cybernetics.

[5]  A Blake,et al.  Shape from specularities: computation and psychophysics. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  H. Piaggio.  Differential Geometry of Curves and Surfaces , 1952, Nature.

[7]  C. Dyer,et al.  Dynamic shading, motion parallax and qualitative shape , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[8]  Andrew Blake,et al.  Detecting Specular Reflections Using Lambertian Constraints , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[9]  Howard J. Schultz,et al.  Retrieving Shape Information from Multiple Images of a Specular Surface , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[11]  Chia-Hoang Lee,et al.  Using highlights to constrain object size and location , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  S. W. Lee.  Understanding of surface reflections in computer vision by color and multiple views , 1992 .

[13]  Lee E. Weiss,et al.  Structured Highlight Inspection of Specular Surfaces , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[15]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[16]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Michael E. Taylor,et al.  Differential Geometry I , 1994 .

[18]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[19]  Consuelo Bellver-Cebreros,et al.  Caustics and the Legendre transform , 1992 .

[20]  Peter Frank Symosek.  Parameter estimation and classification of machine parts based on specular or mirror-like image data (robot vision, shape from shading, surface classification) , 1985 .

[21]  S. Cornbleet,et al.  Microwave and Optical Ray Geometry , 1984 .

[22]  Norihiro Abe,et al.  Shape and model from specular motion , 1995, Proceedings of IEEE International Conference on Computer Vision.

[23]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[24]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image Vis. Comput..

[25]  Andrew Blake,et al.  Geometry From Specularities , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[26]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[27]  M. Longuet-Higgins.  Reflection and Refraction at a Random Moving Surface. I. Pattern and Paths of Specular Points , 1960 .

[28]  P. Giblin,et al.  Curves and Singularities , 1984 .