Variational approach to interreflection in color images

Interreflections affect the colors of surfaces as they appear in images. The light reflected by one surface then impinges upon a second surface changes the color of the overall illumination that it receives and that hence the color of the light that it reflects. Both the relative colors and positions of the two surfaces affect the result. We analyze the physics of the interreflection process and extract constraints on the possible surface reflectances, ambient illumination, and geometric configuration of the surfaces. By using the calculus of variations, a finite-dimensional model of reflectance, and a one-bounce model of interreflection, we express these constraints as a set of equations that are then solved for the surface spectral reflectance functions of the surfaces, the spectrum of the ambient illumination, and local interreflection factors related to the scene geometry. The interreflection factors express how the image is altered by interreflection effects and can be used to produce an image shaded as it would appear had there been no interreflection; the surface reflectance functions provide color constancy. Although it is more complex than some previous analyses of interreflection, the variational approach is more general and relaxes some restrictive assumptions concerning the type of illumination and the number of surfaces.

[1]  Illuminating Engineering Society , 1946, Nature.

[2]  R. Courant,et al.  Methods of Mathematical Physics , 1962 .

[3]  D. B. Judd,et al.  Spectral Distribution of Typical Daylight as a Function of Correlated Color Temperature , 1964 .

[4]  J. Cohen Dependency of the spectral reflectance curves of the Munsell color chips , 1964 .

[5]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[6]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[7]  E. Sparrow,et al.  Radiation Heat Transfer , 1978 .

[8]  M. Pinar Mengüç,et al.  Thermal Radiation Heat Transfer , 2020 .

[9]  J. Koenderink,et al.  Geometrical modes as a general method to treat diffuse interreflections in radiometry , 1983 .

[10]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[11]  John R. Rice,et al.  Solving elliptic problems using ELLPACK , 1985, Springer series in computational mathematics.

[12]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[13]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[14]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[15]  John K. Tsotsos,et al.  Ambient illumination and the determination of material changes. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[16]  Brian A. Wandell,et al.  The Synthesis and Analysis of Color Images , 1992, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance , 1987 .

[18]  Roy Hall,et al.  Illumination and Color in Computer Generated Imagery , 1988, Monographs in Visual Communication.

[19]  Lie group analysis and similarity solutions for the equation , 1989 .

[20]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Mark S. Drew,et al.  Separating a Color Signal into Illumination and Surface Reflectance Components: Theory and Applications , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Takeo Kanade,et al.  Shape from interreflections , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[23]  David A. Forsyth,et al.  Shape from shading in the light of mutual illumination , 1990, Image and Vision Computing.

[24]  Mark S. Drew,et al.  Calculating surface reflectance using a single-bounce model of mutual reflection , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[25]  Mark S. Drew,et al.  Color Space Analysis of Mutual Illumination , 1992, IEEE Trans. Pattern Anal. Mach. Intell..