Surface reconstruction via Helmholtz reciprocity with a single image pair

This paper proposes a method for three-dimensional reconstruction of surfaces that takes advantage of the symmetry resulting from alternating the positions of a camera and a light source. This set up allows for use of the Helmholtz reciprocity principle to recover the shape of smooth surfaces with arbitrary bidirectional reflectance distribution functions without requiring the presence of texture, as well as for exploiting mutual occlusions between images. Different from previous methods, the technique works with as few as one reciprocal pair, and recovers surface depth and orientation simultaneously by finding the global minimum of an error function via dynamic programming. Since the error is a function not just of depth but of surface orientation as well, the reconstruction is subject to tighter geometric constraints. Given a current estimate of surface geometry and intensity measurements in one image, Helmholtz reciprocity is used to predict the pixel intensity values of the second image. The dynamic program finds the reconstruction that minimizes the total difference between the predicted and measured intensity values. This approach allows for the reconstruction of surfaces displaying specularities and regions of high curvature, which is a challenge commonly encountered in the optical inspection of industrial parts. Results with real data show the quality of the reconstruction obtained with the proposed algorithm.

[1]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[2]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Takashi Matsuyama,et al.  Shape from Shading with Interreflections Under a Proximal Light Source: Distortion-Free Copying of an Unfolded Book , 1997, International Journal of Computer Vision.

[4]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[5]  Rayleigh Lord,et al.  XXVIII. On the law of reciprocity in diffuse reflexion , 1900 .

[6]  Azriel Rosenfeld,et al.  Determining plane orientation from specular reflectance , 1985, Pattern Recognit..

[7]  H. Helmholtz.  Helmholtz's Treatise on Physiological Optics , 1963 .

[8]  Berthold K. P. Horn,et al.  Determining Shape and Reflectance Using Multiple Images , 1978 .

[9]  William C Snyder.  Structured surface bidirectional reflectance distribution function reciprocity: theory and counterexamples. , 2002, Applied optics.

[10]  Robert J. Woodham,et al.  Reflectance map techniques for analyzing surface defects in metal castings , 1978 .

[11]  William C. Snyder.  Structured Surface BRDF Reciprocity: Theory and Counterexamples , 2002 .

[12]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[13]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[14]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[16]  H. Gouraud.  Continuous Shading of Curved Surfaces , 1971, IEEE Transactions on Computers.

[17]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[18]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[19]  Chia-Hoang Lee,et al.  Using highlights to constrain object size and location , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  David J. Kriegman,et al.  Beyond Lambert: reconstructing surfaces with arbitrary BRDFs , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[21]  Takeo Kanade,et al.  Shape from interreflections , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[22]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[23]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[24]  J. Koenderink,et al.  Geometrical modes as a general method to treat diffuse interreflections in radiometry , 1983 .

[25]  Shree K. Nayar,et al.  Generalization of the Lambertian model and implications for machine vision , 1995, International Journal of Computer Vision.