Real-time Image Based Lighting with Streaming HDR-light Probe Sequences

This work presents a framework for shading of virtual objects using high dynamic range (HDR) light probe sequences in real-time. The method is based on using HDR environment map of the scene which ...

[1]  Robin Green,et al.  Spherical Harmonic Lighting: The Gritty Details , 2003 .

[2]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[3]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[4]  Yves D. Willems,et al.  Bi-directional path tracing , 1993 .

[5]  Shree K. Nayar,et al.  Optical Splitting Trees for High-Precision Monocular Imaging , 2007, IEEE Computer Graphics and Applications.

[6]  Tomas Akenine-Möller,et al.  Fast, minimum storage ray/triangle intersection , 1997, J. Graphics, GPU, & Game Tools.

[7]  Wolfgang Heidrich,et al.  Sequential sampling for dynamic environment maps , 2006, SIGGRAPH '06.

[8]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, SIGGRAPH 2011.

[9]  Stefan Gustavson,et al.  High-dynamic-range video for photometric measurement of illumination , 2007, Electronic Imaging.

[10]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, ACM Trans. Graph..

[11]  K. Ruedenberg,et al.  Rotation Matrices for Real Spherical Harmonics. Direct Determination by Recursion , 1998 .

[12]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[13]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[14]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[15]  Shree K. Nayar,et al.  Enhancing resolution along multiple imaging dimensions using assorted pixels , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Peter-Pike J. Sloan,et al.  Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation , 2006, SIGGRAPH 2006.

[17]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[18]  Claude Puech,et al.  Radiosity and global illumination , 1994 .

[19]  Henrik Wann Jensen,et al.  Importance Sampling Spherical Harmonics , 2009, Comput. Graph. Forum.

[20]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[21]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.

[22]  Stefan Gustavson,et al.  Next generation image based lighting using HDR video , 2011, SIGGRAPH '11.

[23]  Narendra Ahuja,et al.  High Dynamic Range Video Using Split Aperture Camera , 2005 .

[24]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[25]  E. Hewitt,et al.  The Gibbs-Wilbraham phenomenon: An episode in fourier analysis , 1979 .

[26]  Ravi Ramamoorthi,et al.  Modeling Illumination Variation with Spherical Harmonics , 2005 .

[27]  Paul E. Debevec,et al.  Image-based lighting , 2002, IEEE Computer Graphics and Applications.

[28]  Peter-Pike J. Sloan,et al.  Local, deformable precomputed radiance transfer , 2005, ACM Trans. Graph..

[29]  Narendra Ahuja,et al.  Split Aperture Imaging for High Dynamic Range , 2004, International Journal of Computer Vision.

[30]  Stefan Gustavson,et al.  Real-time HDR video reconstruction for multi-sensor systems , 2012, SIGGRAPH '12.

[31]  Henrik Wann Jensen,et al.  State of the Art in Monte Carlo Ray Tracing for Realistic Image Synthesis , 2001 .

[32]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[33]  Jan Kautz,et al.  Fast Arbitrary BRDF Shading for Low-Frequency Lighting Using Spherical Harmonics , 2002, Rendering Techniques.

[34]  Kun Zhou,et al.  Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation , 2006, ACM Trans. Graph..

[35]  Matthias Zwicker,et al.  Progressive photon mapping: A probabilistic approach , 2011, TOGS.

[36]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[37]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .