Optimizing Environment Maps for Material Depiction

We present an automated system for optimizing and synthesizing environment maps that enhance the appearance of materials in a scene. We first identify a set of lighting design principles for material depiction. Each principle specifies the distinctive visual features of a material and describes how environment maps can emphasize those features. We express these principles as linear or quadratic image quality metrics, and present a general optimization framework to solve for the environment map that maximizes these metrics. We accelerate metric evaluation using an approach dual to precomputed radiance transfer (PRT). In contrast to standard PRT that integrates light transport over the lighting domain to generate an image, we pre‐integrate light transport over the image domain to optimize for lighting. Finally we present two techniques for transforming existing photographic environment maps to better emphasize materials. We demonstrate the effectiveness of our approach by generating environment maps that enhance the depiction of a variety of materials including glass, metal, plastic, marble and velvet.

[1]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[2]  Dani Lischinski,et al.  Automatic Lighting Design using a Perceptual Quality Metric , 2001, Comput. Graph. Forum.

[3]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[4]  Philip Dutré,et al.  Image-based lighting design , 2004 .

[5]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[6]  Amitabh Varshney,et al.  Geometry-dependent lighting , 2006, IEEE Transactions on Visualization and Computer Graphics.

[7]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[8]  Heinrich H. Bülthoff,et al.  Perceiving translucent materials , 2004, APGV '04.

[9]  Fabio Pellacini,et al.  Toward evaluating lighting design interface paradigms for novice users , 2009, ACM Trans. Graph..

[10]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[11]  Szymon Rusinkiewicz,et al.  Exaggerated shading for depicting shape and detail , 2006, ACM Trans. Graph..

[12]  Peter Shirley,et al.  A microfacet-based BRDF generator , 2000, SIGGRAPH.

[13]  Greg Humphreys,et al.  Physically Based Rendering, Second Edition: From Theory To Implementation , 2010 .

[14]  Jan J. Koenderink,et al.  The secret of velvety skin , 2003, Machine Vision and Applications.

[15]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[16]  Pierre Poulin,et al.  Lights from highlights and shadows , 1992, I3D '92.

[17]  Pascal Barla,et al.  Light warping for enhanced surface depiction , 2009, ACM Trans. Graph..

[18]  Stefan Gumhold,et al.  Maximum entropy light source placement , 2002, IEEE Visualization, 2002. VIS 2002..

[19]  Pat Hanrahan,et al.  A signal-processing framework for reflection , 2004, ACM Trans. Graph..

[20]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[21]  Donald P. Greenberg,et al.  A user interface for interactive cinematic shadow design , 2002, SIGGRAPH.

[22]  Fabio Pellacini,et al.  Toward evaluating lighting design interface paradigms for novice users , 2009, SIGGRAPH 2009.

[23]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[24]  Adam Finkelstein,et al.  Lighting with paint , 2007, TOGS.

[25]  Kostas Daniilidis,et al.  Direct 3D-rotation estimation from spherical images via a generalized shift theorem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[26]  Kevin G. Suffern,et al.  Painting with light , 2002, SIGGRAPH '02.

[27]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[28]  Yasuyuki Matsushita,et al.  Illumination Brush: Interactive Design of All-Frequency Lighting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[29]  Sylvain Lefebvre,et al.  Instant Texture Synthesis by Numbers , 2010, VMV.

[30]  Henrik Wann Jensen,et al.  Perceiving translucent materials , 2004 .

[31]  A. Torralba,et al.  Specular reflections and the perception of shape. , 2004, Journal of vision.

[32]  Elaine Cohen,et al.  A non-photorealistic lighting model for automatic technical illustration , 1998, SIGGRAPH.

[33]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[34]  Fabio Pellacini,et al.  envyLight: an interface for editing natural illumination , 2010, ACM Trans. Graph..

[35]  Ravi Ramamoorthi,et al.  Real-time BRDF editing in complex lighting , 2006, ACM Trans. Graph..

[36]  David S. Ebert,et al.  Visualization and computer graphics , 2007 .

[37]  James A. Ferwerda,et al.  Effects of Image Dynamic Range on Apparent Surface Gloss , 2009, CIC.

[38]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..