Algorithms for rendering depth of field effects in computer graphics

Computer generated images by default render the entire scene in perfect focus. Both camera optics and the human visual system have limited depth of field, due to the finite aperture or pupil of the optical system. For more realistic computer graphics as well as to enable artistic control over what is and what is not in focus, it is desirable to add depth of field blurring. Starting with the work of Potmesil and Chakravarty[33][34], there have been numerous approaches to adding depth of field effects to computer graphics. Published work in depth of field for computer graphics has been previously surveyed by Barsky [2][3]. Later, interactive depth of field techniques were surveyed by Demers [12]. Subsequent to these surveys, however, there have been important developments. This paper surveys depth of field approaches in computer graphics, from its introduction to the current state of the art.

[1]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part I, Object-Based Techniques , 2003, ICCSA.

[2]  John D. Owens,et al.  Interactive Depth of Field Using Simulated Diffusion on a GPU , 2006 .

[3]  Matthias Zwicker,et al.  Ieee Transactions on Visualization and Computer Graphics Ewa Splatting , 2002 .

[4]  Brian A. Barsky,et al.  An Algorithm for Rendering Generalized Depth of Field Effects Based on Simulated Heat Diffusion , 2007, ICCSA.

[5]  Martin Kraus,et al.  Depth‐of‐Field Rendering by Pyramidal Image Processing , 2007, Comput. Graph. Forum.

[6]  Anselmo Lastra,et al.  Fast Summed‐Area Table Generation and its Applications , 2005, Comput. Graph. Forum.

[7]  Silvia Miksch,et al.  Useful Properties of Semantic Depth of Field for Better F+C Visualization , 2002, VisSym.

[8]  Brian A. Barsky,et al.  Elimination of artifacts due to occlusion and discretization problems in image space blurring techniques , 2005, Graph. Model..

[9]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[10]  Jim X. Chen,et al.  Accurate Depth of Field Simulation in Real Time , 2007, Comput. Graph. Forum.

[11]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part II, Image-Based Techniques , 2003, ICCSA.

[12]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[13]  Edwin E. Catmull,et al.  An analytic visible surface algorithm for independent pixel processing , 1984, SIGGRAPH.

[14]  Frédo Durand,et al.  Defocus Magnification , 2007, Comput. Graph. Forum.

[15]  Michael Potmesil,et al.  A lens and aperture camera model for synthetic image generation , 1981, SIGGRAPH '81.

[16]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[17]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[18]  Markus H. Gross,et al.  A Framework for Holographic Scene Representation and Image Synthesis , 2006, IEEE Transactions on Visualization and Computer Graphics.

[19]  Hans-Peter Seidel,et al.  An Image-Based Model for Realistic Lens Systems in Interactive Computer Graphics , 1997, Graphics Interface.

[20]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[21]  Paul Fearing.  Importance Ordering for Real-Time Depth of Field , 1995, ICSC.

[22]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[23]  Marcelo Bertalmío,et al.  Real-time, accurate depth of field using anisotropic diffusion and programmable graphics cards , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[24]  Michael Potmesil,et al.  Synthetic Image Generation with a Lens and Aperture Camera Model , 1982, TOGS.

[25]  Cary Scofield,et al.  -d depth-of-field simulation for Computer animation , 1992, Graphics Gems III.

[26]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[27]  Anatole Lécuyer,et al.  Depth-of-Field Blur Effects for First-Person Navigation in Virtual Environments , 2008, IEEE Computer Graphics and Applications.

[28]  Ren Ng.  Fourier Slice Photography , 2005 .

[29]  Przemyslaw Rokita,et al.  Generating depth of-field effects in virtual reality applications , 1996, IEEE Computer Graphics and Applications.

[30]  Jirí Zára,et al.  Fast depth of field rendering with surface splatting , 2003, Proceedings Computer Graphics International 2003.

[31]  Matthias Zwicker,et al.  3 Ideal Resampling 3 . 1 Sampling and Aliasing , 2022 .

[32]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[33]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[34]  Emil Wolf,et al.  Principles of Optics: Contents , 1999 .

[35]  Robert van Liere,et al.  Fast perception-based depth of field rendering , 2000, VRST '00.

[36]  Brian A. Barsky,et al.  Investigating Occlusion and Discretization Problems in Image-Based Blurring Techniques , 2003, VVG.

[37]  Markus H. Gross,et al.  Lighting and Occlusion in a Wave‐Based Framework , 2008, Comput. Graph. Forum.

[38]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[39]  Steven G. Johnson,et al.  The Design and Implementation of FFTW3 , 2005, Proceedings of the IEEE.

[40]  Brian A. Barsky.  Vision-realistic rendering: simulation of the scanned foveal image from wavefront data of human subjects , 2004, APGV '04.