Direct Solution of Orientation-from-Color Problem Using a Modification of Pentland's Light Source Direction Estimator

If a uniformly colored Lambertian surface is illuminated by a collection of point or extended light sources or interreflections, with unknown directions and strengths, such that illumination varies spectrally with orientation from the surface, then surface normals can be recovered up to an orthogonal transformation using a robust regression on points in color space. Recently, it was shown that the unknown orthogonal transformation can be recovered by applying an integrability condition on the recovered normals. However, the integrability method results in an unavoidable convex/concave ambiguity additional to the usual one. Here a much simpler method is set out that avoids this ambiguity. Using Pentland's or a similar tilt estimator for each of the RGB channels in turn, in effect treating the combination of lights as three single sources, the robust color space regression leads to three constraints on the slants of the three sources. The result is accurate recovery of light source directions and hence of surface normals. A self-check mechanism for evaluating the algorithm's performance on real images is introduced.

[1]  R. Woodham,et al.  Photometric Stereo: Lambertian Reflectance and Light Sources with Unknown Direction and Strength , 1991 .

[2]  A. Pentland Finding the illuminant direction , 1982 .

[3]  P. Rousseeuw Least Median of Squares Regression , 1984 .

[4]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[5]  Mark S. Drew,et al.  Closed-form attitude determination under spectrally varying illumination , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Leonid L. Kontsevich,et al.  Reconstruction of shape from shading in color images , 1994 .

[7]  D. Jameson,et al.  Some Quantitative Aspects of an Opponent-Colors Theory. I. Chromatic Responses and Spectral Saturation , 1955 .

[8]  D JAMESON,et al.  Some quantitative aspects of an opponent-colors theory. IV. A psychological color specification system. , 1956, Journal of the Optical Society of America.

[9]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[10]  A. P. Petrov On obtaining shape from color shading , 1993 .

[11]  M. S. Drew Robust Specularity Detection from a Single Multi-Illuminant Color Image , 1994 .

[12]  R. Woodham Gradient and Curvature from Photometric Stereo Including Local Condence Estimation , 1994 .

[13]  A. P. Petrov,et al.  Properties of color images of surfaces under multiple illuminants , 1994 .

[14]  Alexander P. Petrov Color and Grassmann-Cayley coordinates of shape , 1991, Electronic Imaging.

[15]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[16]  A. P. Petrov Surface color and color constancy , 1993 .

[17]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[19]  RosenfeldAzriel,et al.  Improved methods of estimating shape from shading using the light source coordinate system , 1985 .

[20]  Wojciech Chojnacki,et al.  Light source direction from a single image: a performance analysis , 1991, Aust. Comput. J..

[21]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  M. Brooks,et al.  Revisiting Pentland's estimator of light source direction , 1994 .

[23]  Mark S. Drew Reduction of rank-reduced orientation-from-color problem with many unknown lights to two-image known-illuminant photometric stereo , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[24]  J. Miller Numerical Analysis , 1966, Nature.