Shape and Reflectance from Image Intensities

This paper presents new results in the area of image intensity understanding. We address the problem of recovering three-dimensional shapes of surfaces from twc-dimensional intensity images. Previous shape-fromintensity methods are not applicable to surfaces with varying reflectance properties. These methods are also inaccurate in the case of concave surfaces as they do not account for interreflections. Here, we present shape recovery methods that overcome both these problems. Our solutions are based on physics-based models of reflection and interreflection. Multiple images of a surface are obtained by varying the source direction. Shape and reflectance parameters are computed simultaneously from the measured image intensities. Experimental results are included to demonstrate the accuracy and robustness of the proposed shape recovery methods.

[1]  Lee E. Weiss,et al.  Specular surface inspection using structured highlight and Gaussian images , 1990, IEEE Trans. Robotics Autom..

[2]  Mark S. Drew,et al.  Calculating surface reflectance using a single-bounce model of mutual reflection , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[3]  Rui J. P. de Figueiredo,et al.  Simultaneous estimation of shape and reflectance map from photometric stereo , 1992, CVGIP Image Underst..

[4]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[5]  Robert J. Woodham,et al.  Photometric Stereo: A Reflectance Map Technique For Determining Surface Orientation From Image Intensity , 1979, Optics & Photonics.

[6]  Takeo Kanade,et al.  Determining shape and reflectance of hybrid surfaces by photometric sampling , 1989, IEEE Trans. Robotics Autom..

[7]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  J. Koenderink,et al.  Geometrical modes as a general method to treat diffuse interreflections in radiometry , 1983 .

[9]  J. Reichman.  Determination of absorption and scattering coefficients for nonhomogeneous media. 1: theory. , 1973, Applied optics.

[10]  P. Beckmann,et al.  The scattering of electromagnetic waves from rough surfaces , 1963 .

[11]  B K Horn,et al.  Calculating the reflectance map. , 1979, Applied optics.

[12]  Shree K. Nayar,et al.  Determining Surface Orientations Of Specular Surfaces By Intensity Encoded Illumination , 1988, Other Conferences.

[13]  Donald P. Greenberg,et al.  The hemi-cube: a radiosity solution for complex environments , 1985, SIGGRAPH.

[14]  Michael H. Brill.  Object-Based Segmentation And Color Recognition In Multispectral Images , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[15]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[16]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Rui J. P. de Figueiredo,et al.  Simultaneous estimation of shape and reflectance maps from photometric stereo , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[18]  Berthold K. P. Horn.  Image Intensity Understanding , 1975 .

[19]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[20]  Thomas O. Binford,et al.  Local shape from specularity , 1988, Comput. Vis. Graph. Image Process..

[21]  Shree K. Nayar,et al.  Shape Recovery using Physical Models of Reflection and Interreflection , 1991 .

[22]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  E. North Coleman,et al.  Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry , 1982, Comput. Graph. Image Process..

[24]  Lee E. Weiss,et al.  Structured Highlight Inspection of Specular Surfaces , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Sang Wook Lee,et al.  Image Segmentation with Detection of Highlights and Inter-Reflections Using Color , 1989 .

[26]  Berthold K. P. Horn,et al.  Hill shading and the reflectance map , 1981, Proceedings of the IEEE.