Property and Lighting Manipulations for Static Volume Stylization Using a Painting Metaphor

Although volumetric phenomena are important for realistic rendering and can even be a crucial component in the image, the artistic control of the volume's appearance is challenging. Appropriate tools to edit volume properties are missing, which can make it necessary to use simulation results directly. Alternatively, high-level modifications that are rarely intuitive, e.g., the tweaking of noise function parameters, can be utilized. Our work introduces a solution to stylize single-scattering volumetric effects in static volumes. Hereby, an artistic and intuitive control of emission, scattering and extinction becomes possible, while ensuring a smooth and coherent appearance when changing the viewpoint. Our method is based on tomographic reconstruction, which we link to the volumetric rendering equation. It analyzes a number of target views provided by the artist and adapts the volume properties to match the appearance for the given perspectives. Additionally, we describe how we can optimize for the environmental lighting to match a desired scene appearance, while keeping volume properties constant. Finally, both techniques can be combined. We demonstrate several use cases of our approach and illustrate its effectiveness.

[1]  Hans-Peter Seidel,et al.  3D Reconstruction of Emission and Absorption in Planetary Nebulae , 2007, VG@Eurographics.

[2]  Tim Weyrich,et al.  Fabricating microgeometry for custom surface reflectance , 2009, ACM Trans. Graph..

[3]  Jos Stam,et al.  Stable fluids , 1999, SIGGRAPH.

[4]  Jörg-Stefan Praßni,et al.  Stroke-Based Transfer Function Design , 2008, VG/PBG@SIGGRAPH.

[5]  David K. McAllister,et al.  OptiX: a general purpose ray tracing engine , 2010, ACM Trans. Graph..

[6]  Matthias Zwicker,et al.  Progressive photon beams , 2011, ACM Trans. Graph..

[7]  Wojciech Matusik,et al.  Computing and fabricating multilayer models , 2011, ACM Trans. Graph..

[8]  Hans-Peter Seidel,et al.  Time-resolved 3d capture of non-stationary gas flows , 2008, SIGGRAPH Asia '08.

[9]  Hans-Peter Seidel,et al.  Time-resolved 3d capture of non-stationary gas flows , 2008, SIGGRAPH 2008.

[10]  Adam Finkelstein,et al.  Lighting with paint , 2007, TOGS.

[11]  John Amanatides,et al.  A Fast Voxel Traversal Algorithm for Ray Tracing , 1987, Eurographics.

[12]  Fabio Pellacini,et al.  BendyLights: Artistic Control of Direct Illumination by Curving Light Rays , 2010, Comput. Graph. Forum.

[13]  G. Rybicki Radiative transfer , 2019, Climate Change and Terrestrial Ecosystem Modeling.

[14]  Ravi Ramamoorthi,et al.  Interactive albedo editing in path-traced volumetric materials , 2013, TOGS.

[15]  Niloy J. Mitra,et al.  Shadow art , 2009, ACM Trans. Graph..

[16]  Elmar Eisemann,et al.  Interactive Indirect Illumination Using Voxel Cone Tracing , 2011, Comput. Graph. Forum.

[17]  Pieter Peers,et al.  SubEdit: a representation for editing measured heterogeneous subsurface scattering , 2009, ACM Trans. Graph..

[18]  Kevin G. Suffern,et al.  Painting with light , 2002, SIGGRAPH '02.

[19]  Leonidas J. Guibas,et al.  Robust Monte Carlo methods for light transport simulation , 1997 .

[20]  Hans-Peter Seidel,et al.  Volume stylizer: tomography-based volume painting , 2013, I3D '13.

[21]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[22]  Derek Nowrouzezahrai,et al.  A programmable system for artistic volumetric lighting , 2011, ACM Trans. Graph..

[23]  Adrien Treuille,et al.  Keyframe control of smoke simulations , 2003, ACM Trans. Graph..

[24]  Marcus A. Magnor,et al.  Reconstructing the geometry of flowing water , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[25]  Sumanta N. Pattanaik,et al.  Visibility Editing For All‐Frequency Shadow Design , 2010, Comput. Graph. Forum.

[26]  Hans-Peter Seidel,et al.  Eikonal rendering: efficient light transport in refractive objects , 2007, SIGGRAPH '07.

[27]  Niloy J. Mitra,et al.  Shadow art , 2009, SIGGRAPH 2009.

[28]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[29]  Markus H. Gross,et al.  The magic lens , 2012, ACM Trans. Graph..

[30]  Yasuyuki Matsushita,et al.  Illumination Brush: Interactive Design of All-Frequency Lighting , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[31]  Derek Bradley,et al.  Manufacturing Layered Attenuators for Multiple Prescribed Shadow Images , 2012, Comput. Graph. Forum.

[32]  James T. Kajiya,et al.  Ray tracing volume densities , 1984, SIGGRAPH.

[33]  Marcus A. Magnor,et al.  Image-based tomographic reconstruction of flames , 2004, SIGGRAPH '04.

[34]  Dieter Schmalstieg,et al.  Softshell , 2012, ACM Trans. Graph..

[35]  Adrien Bousseau,et al.  Real-time rough refraction , 2011, SI3D.

[36]  Gordon Wetzstein,et al.  Polarization fields: dynamic light field display using multi-layer LCDs , 2011, SA '11.

[37]  Gordon Wetzstein,et al.  Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays , 2011, ACM Trans. Graph..

[38]  Sumanta N. Pattanaik,et al.  iCheat: A Representation for Artistic Control of Indirect Cinematic Lighting , 2008, Comput. Graph. Forum.

[39]  Yoshinori Dobashi,et al.  An inverse problem approach for automatically adjusting the parameters for rendering clouds using photographs , 2012, ACM Trans. Graph..

[40]  Hans-Peter Seidel,et al.  Towards passive 6D reflectance field displays , 2008, ACM Trans. Graph..

[41]  Baining Guo,et al.  Pocket reflectometry , 2011, SIGGRAPH 2011.

[42]  Tim Weyrich,et al.  Goal‐based Caustics , 2011, Comput. Graph. Forum.

[43]  Xiaoru Yuan,et al.  WYSIWYG (What You See is What You Get) Volume Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[44]  Elmar Eisemann,et al.  Efficient Rendering of Highly Detailed Volumetric Scenes with Giga Voxels , 2010, GPU Pro.

[45]  Derek Nowrouzezahrai,et al.  Progressive Virtual Beam Lights , 2012, Comput. Graph. Forum.

[46]  Gordon Wetzstein,et al.  Tensor displays , 2012, ACM Trans. Graph..

[47]  Hans-Peter Seidel,et al.  3D Material Style Transfer , 2012, Comput. Graph. Forum.

[48]  Marcus A. Magnor,et al.  Adaptive grid optical tomography , 2006, Graph. Model..

[49]  M. Glas,et al.  Principles of Computerized Tomographic Imaging , 2000 .

[50]  Adrien Treuille,et al.  Fluid control using the adjoint method , 2004, ACM Trans. Graph..

[51]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[52]  Shi-Min Hu,et al.  Popup: automatic paper architectures from 3D models , 2010, SIGGRAPH 2010.

[53]  Paul Debevec,et al.  Acquisition of time-varying participating media , 2005, SIGGRAPH 2005.