Modeling image irradiance under natural illumination and isotropic surface reflectance

Discounting subsurface scattering and surface emittance, this work seeks to address the question; how to accurately represent image irradiance under unknown general illumination and reflectance, given that a surface point sees its surrounding world through the local upper hemisphere oriented by the surface normal at this point. In this paper, we formulate the image formation process of isotropic surfaces under arbitrary distant illumination in the frequency space while addressing the physical compliance of hemispherical basis for representing surface reflectance, e.g. Helmholtz reciprocity and isotropy. This representation is further reduced in dimensionality through analytically deriving the principal components of the image irradiance. A database of natural illumination and real world surface materials are used to compute a general-purpose basis which captures the full behavior of illumination and reflectance in a lower-dimensional subspace for image irradiance representation. Compared to similar basis in literature, our proposed basis achieves higher accuracy levels at lower illumination orders.

[1]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Ravi Ramamoorthi,et al.  Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jan-Olof Eklundh,et al.  Phenomenological eigenfunctions for image irradiance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Aly A. Farag,et al.  Towards Efficient and Compact Phenomenological Representation of Arbitrary Bidirectional Surface Reflectance , 2011, BMVC.

[5]  Pat Hanrahan,et al.  Frequency space environment map rendering , 2002, SIGGRAPH.

[6]  Sumanta N. Pattanaik,et al.  Eurographics Symposium on Rendering (2004) a Novel Hemispherical Basis for Accurate and Efficient Rendering , 2022 .

[7]  J. Koenderink,et al.  Phenomenological description of bidirectional surface reflection , 1998 .

[8]  Daniel Snow,et al.  Determining Generative Models of Objects Under Varying Illumination: Shape and Albedo from Multiple Images Using SVD and Integrability , 1999, International Journal of Computer Vision.

[9]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[10]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Pat Hanrahan,et al.  A signal-processing framework for forward and inverse rendering , 2002 .

[12]  E. Wigner,et al.  Book Reviews: Group Theory. And Its Application to the Quantum Mechanics of Atomic Spectra , 1959 .

[13]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.