Local shape from specularity

We show that highlights in images of objects with specularly reflecting surfaces provide significant information about the surfaces which generate them. A brief survey is given of specular reflectance models which have been used in computer vision and graphics. For our work, we adopt the Torrance-Sparrow specular model which, unlike most previous models, considers the underlying physics of specular reflection from rough surfaces. From this model we derive powerful relationships between the properties of a specular feature in an image and local properties of the corresponding surface. We show how this analysis can be used for both prediction and interpretation in a vision system. A shape from specularity system has been implemented to test our approach. The performance of the system is demonstrated by careful experiments with specularly reflecting objects.

[1]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[2]  R. S. Clark.  INTRODUCTION TO DIFFERENTIAL GEOMETRY AND RIEMANNIAN GEOMETRY , 1970 .

[3]  Andrew Blake,et al.  Specular Stereo , 1985, IJCAI.

[4]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[5]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[6]  P. Deift,et al.  Some remarks on the shape-from-shading problem in computer vision☆ , 1981 .

[7]  B. R. Hunt,et al.  Digital Image Restoration , 1977 .

[8]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[9]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  W. Eric L. Grimson,et al.  Binocular shading and visual surface reconstruction , 1984, Comput. Vis. Graph. Image Process..

[11]  E. North Coleman,et al.  Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry , 1982, Comput. Graph. Image Process..

[12]  Anna R. Bruss.  The Image Irradiance Equation: Its Solution and Application , 1981 .

[13]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[14]  Steven A. Shafer.  Optical Phenomena in Computer Vision , 1984 .

[15]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[16]  James D. Foley,et al.  Fundamentals of interactive computer graphics , 1982 .

[17]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[18]  David M. Chelberg,et al.  Acronym Modi Based Vision In The Intelligent Task Automation Project. , 1984, Optics & Photonics.

[19]  Robert J. Woodham,et al.  Photometric Stereo: A Reflectance Map Technique For Determining Surface Orientation From Image Intensity , 1979, Optics & Photonics.

[20]  E. Sparrow,et al.  Radiation Heat Transfer , 1978 .

[21]  Harry C. Andrews,et al.  Digital image restauration , 1977 .

[22]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[23]  T. Kanade,et al.  USING A COLOR REFLECTION MODEL TO SEPARATE HIGHLIGHTS FROM OBJECT COLOR , 1987 .

[24]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.