Lighting with paint

Lighting is a fundamental aspect of computer cinematography that involves the placement and configuration of lights to establish mood and enhance storytelling. This process is labor intensive as artists repeatedly adjust the parameters of a large set of complex lights to achieve a desired effect. Typical lighting controls affect the final image indirectly, requiring a large number of trials to obtain a suitable result. We present an interactive system wherein an artist paints desired lighting effects directly into the scene, and the computer solves for parameters that achieve the desired look. The artist can paint color, light shape, shadows, highlights, and reflections using a suite of tools designed for painting light. Our system matches these effects using a nonlinear optimizer made robust by a combination of initial estimates, system design, and user-guided optimization. In contrast, previous work on painting light has not permitted the lights to move, allowing for linear optimization but preventing its use in computer cinematography. To demonstrate our approach we lit several scenes, mainly using a direct illumination renderer designed for computer animation, but also including two other rendering styles. We show that painting interfaces can quickly produce high quality lighting setups, easing the lighting artist's workflow.

[1]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[2]  Cindy Grimm,et al.  Table-top computed lighting for practical digital photography , 2005, EGSR '05.

[3]  Gustavo Patow,et al.  A Survey of Inverse Rendering Problems , 2003, Comput. Graph. Forum.

[4]  Donald P. Greenberg,et al.  A user interface for interactive cinematic shadow design , 2002, SIGGRAPH.

[5]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[6]  Pierre Poulin,et al.  Painting Surface Characteristics , 1995, Rendering Techniques.

[7]  Kiril Vidimce,et al.  Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography , 2005, SIGGRAPH 2005.

[8]  J. Alton Painting with Light , 1949 .

[9]  Aaron E. Lefohn,et al.  Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography , 2005, SIGGRAPH '05.

[10]  Pierre Poulin,et al.  Lights from highlights and shadows , 1992, I3D '92.

[11]  Dani Lischinski,et al.  Automatic Lighting Design using a Perceptual Quality Metric , 2001, Comput. Graph. Forum.

[12]  M. Powell A Direct Search Optimization Method That Models the Objective and Constraint Functions by Linear Interpolation , 1994 .

[13]  Pierre Poulin,et al.  Sketching shadows and highlights to position lights , 1997, Proceedings Computer Graphics International.

[14]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[15]  HanrahanPat,et al.  Direct WYSIWYG painting and texturing on 3D shapes , 1990 .

[16]  Philip Dutré,et al.  Image-based lighting design , 2004 .

[17]  Yang Wang,et al.  Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry , 2002, ECCV.

[18]  Donald P. Greenberg,et al.  Design and simulation of opera lighting and projection effects , 1991, SIGGRAPH.

[19]  James Arvo,et al.  Painting with light , 1993, SIGGRAPH.

[20]  Adam Finkelstein,et al.  Real-time hatching , 2001, SIGGRAPH.

[21]  Stefan Gumhold,et al.  Maximum entropy light source placement , 2002, IEEE Visualization, 2002. VIS 2002..

[22]  William H. Press,et al.  Numerical recipes in C (2nd ed.): the art of scientific computing , 1992 .

[23]  Michael F. Cohen,et al.  Radioptimization: goal based rendering , 1993, SIGGRAPH.

[24]  António Augusto de Sousa,et al.  Lighting Design: A Goal Based Approach using Optimisation , 1999, Rendering Techniques.

[25]  Pat Hanrahan,et al.  A fast relighting engine for interactive cinematic lighting design , 2000, SIGGRAPH.

[26]  Ramesh Raskar,et al.  Image precision silhouette edges , 1999, SI3D.

[27]  Adam Finkelstein,et al.  WYSIWYG NPR: drawing strokes directly on 3D models , 2002, SIGGRAPH.

[28]  Stefan Gumhold Maximum entropy light source placement , 2002 .

[29]  Kevin G. Suffern,et al.  Painting with light , 2002, SIGGRAPH '02.

[30]  Ronen Barzel,et al.  Lighting Controls for Computer Cinematography , 1997, J. Graphics, GPU, & Game Tools.