Real-time lens blur effects and focus control

We present a novel rendering system for defocus blur and lens effects. It supports physically-based rendering and outperforms previous approaches by involving a novel GPU-based tracing method. Our solution achieves more precision than competing real-time solutions and our results are mostly indistinguishable from offline rendering. Our method is also more general and can integrate advanced simulations, such as simple geometric lens models enabling various lens aberration effects. These latter is crucial for realism, but are often employed in artistic contexts, too. We show that available artistic lenses can be simulated by our method. In this spirit, our work introduces an intuitive control over depth-of-field effects. The physical basis is crucial as a starting point to enable new artistic renderings based on a generalized focal surface to emphasize particular elements in the scene while retaining a realistic look. Our real-time solution provides realistic, as well as plausible expressive results.

[1]  Adam W. Bargteil,et al.  Introducing Vision-Realistic Rendering , 2002 .

[2]  Marcelo Bertalmío,et al.  Real-time, accurate depth of field using anisotropic diffusion and programmable graphics cards , 2004 .

[3]  Sungkil Lee,et al.  Real-Time Depth-of-Field Rendering Using Anisotropically Filtered Mipmap Interpolation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[4]  Hans-Peter Seidel,et al.  Temporal Glare: Real‐Time Dynamic Simulation of the Scattering in the Human Eye , 2009, Comput. Graph. Forum.

[5]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[6]  Jason Lawrence,et al.  AppWand: editing measured materials using appearance-driven optimization , 2007, SIGGRAPH 2007.

[7]  Adrien Bousseau Non-linear aperture for stylized depth of field , 2009, SIGGRAPH '09.

[8]  Brian A. Barsky,et al.  An Algorithm for Rendering Generalized Depth of Field Effects Based on Simulated Heat Diffusion , 2007, ICCSA.

[9]  Hans-Peter Seidel,et al.  Depth-of-field rendering with multiview synthesis , 2009, SIGGRAPH 2009.

[10]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Gustavo Patow,et al.  A Survey of Inverse Rendering Problems , 2003, Comput. Graph. Forum.

[13]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[14]  Cass W. Everitt,et al.  Interactive Order-Independent Transparency , 2001 .

[15]  Fang Liu,et al.  Single pass depth peeling via CUDA rasterizer , 2009, SIGGRAPH '09.

[16]  Warren J. Smith Modern Lens Design , 1992 .

[17]  Sungkil Lee,et al.  Real‐Time Depth‐of‐Field Rendering Using Point Splatting on Per‐Pixel Layers , 2008, Comput. Graph. Forum.

[18]  Przemyslaw Rokita,et al.  Generating depth of-field effects in virtual reality applications , 1996, IEEE Computer Graphics and Applications.

[19]  Sellmeier Zur Erklärung der abnormen Farbenfolge im Spectrum einiger Substanzen , 1871 .

[20]  Brian A. Barsky,et al.  Depth of field postprocessing for layered scenes using constant-time rectangle spreading , 2009, Graphics Interface.

[21]  Michael Potmesil,et al.  A lens and aperture camera model for synthetic image generation , 1981, SIGGRAPH '81.

[22]  Robert L. Cook,et al.  Distributed ray tracing , 1984, SIGGRAPH.

[23]  James Arvo,et al.  Painting with light , 1993, SIGGRAPH.

[24]  Jim X. Chen,et al.  Accurate Depth of Field Simulation in Real Time , 2007, Comput. Graph. Forum.

[25]  Brian A. Barsky,et al.  Rendering skewed plane of sharp focus and associated depth of field , 2004, SIGGRAPH '04.

[26]  Silvia Miksch,et al.  Semantic depth of field , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[27]  John D. Owens,et al.  Interactive Depth of Field Using Simulated Diffusion on a GPU , 2006 .

[28]  Martin Kraus,et al.  Depth‐of‐Field Rendering by Pyramidal Image Processing , 2007, Comput. Graph. Forum.

[29]  Anselmo Lastra,et al.  Fast Summed‐Area Table Generation and its Applications , 2005, Comput. Graph. Forum.

[30]  Pierre Poulin,et al.  Lights from highlights and shadows , 1992, I3D '92.

[31]  George Mather,et al.  Image blur as a pictorial depth cue , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[32]  Brian A. Barsky,et al.  Elimination of artifacts due to occlusion and discretization problems in image space blurring techniques , 2005, Graph. Model..

[33]  Donald P. Greenberg,et al.  A user interface for interactive cinematic shadow design , 2002, SIGGRAPH.

[34]  Manuel Menezes de Oliveira Neto,et al.  Relief mapping of non-height-field surface details , 2006, I3D '06.

[35]  Xavier Décoret N‐Buffers for efficient depth map query , 2005, Comput. Graph. Forum.