Depth of field postprocessing for layered scenes using constant-time rectangle spreading

Control over what is in focus and what is not in focus in an image is an important artistic tool. The range of depth in a 3D scene that is imaged in sufficient focus through an optics system, such as a camera lens, is called depth of field. Without depth of field, the entire scene appears completely in sharp focus, leading to an unnatural, overly crisp appearance. Current techniques for rendering depth of field in computer graphics are either slow or suffer from artifacts, or restrict the choice of point spread function (PSF). In this paper, we present a new image filter based on rectangle spreading which is constant time per pixel. When used in a layered depth of field framework, our filter eliminates the intensity leakage and depth discontinuity artifacts that occur in previous methods. We also present several extensions to our rectangle spreading method to allow flexibility in the appearance of the blur through control over the PSF.

[1]  Eugene Fiume,et al.  Constant-time filtering with space-variant kernels , 1988, SIGGRAPH.

[2]  Wolfgang Engel.  ShaderX3 Advanced Rendering with DirectX and OpenGL (SHADERX SERIES) , 2004 .

[3]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[4]  Justin Hensley,et al.  Efficient histogram generation using scattering on GPUs , 2007, SI3D.

[5]  C. Gotsman.  Constant‐Time Filtering by Singular Value Decomposition † , 1994 .

[6]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[7]  Jim X. Chen,et al.  Accurate Depth of Field Simulation in Real Time , 2007, Comput. Graph. Forum.

[8]  Jirí Zára,et al.  Fast depth of field rendering with surface splatting , 2003, Proceedings Computer Graphics International 2003.

[9]  Edwin E. Catmull,et al.  An analytic visible surface algorithm for independent pixel processing , 1984, SIGGRAPH.

[10]  Michael Potmesil,et al.  Synthetic Image Generation with a Lens and Aperture Camera Model , 1982, TOGS.

[11]  Paul Fearing.  Importance Ordering for Real-Time Depth of Field , 1995, ICSC.

[12]  Martin Kraus,et al.  Depth‐of‐Field Rendering by Pyramidal Image Processing , 2007, Comput. Graph. Forum.

[13]  Anselmo Lastra,et al.  Fast Summed‐Area Table Generation and its Applications , 2005, Comput. Graph. Forum.

[14]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part I, Object-Based Techniques , 2003, ICCSA.

[15]  Marcelo Bertalmío,et al.  Real-time, accurate depth of field using anisotropic diffusion and programmable graphics cards , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[16]  Steven G. Johnson,et al.  The Design and Implementation of FFTW3 , 2005, Proceedings of the IEEE.

[17]  Brian A. Barsky.  Vision-realistic rendering: simulation of the scanned foveal image from wavefront data of human subjects , 2004, APGV '04.

[18]  Przemyslaw Rokita,et al.  Generating depth of-field effects in virtual reality applications , 1996, IEEE Computer Graphics and Applications.

[19]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part II, Image-Based Techniques , 2003, ICCSA.

[20]  Patrick Hébert,et al.  Median Filtering in Constant Time , 2007, IEEE Transactions on Image Processing.

[21]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[22]  Paul S. Heckbert,et al.  Filtering by repeated integration , 1986, SIGGRAPH.

[23]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[24]  Robert van Liere,et al.  Fast perception-based depth of field rendering , 2000, VRST '00.

[25]  Brian A. Barsky,et al.  Investigating Occlusion and Discretization Problems in Image-Based Blurring Techniques , 2003, VVG.

[26]  Brian A. Barsky,et al.  Elimination of artifacts due to occlusion and discretization problems in image space blurring techniques , 2005, Graph. Model..

[27]  G. Rodrigue,et al.  Analysis of the recursive doubling algorithm , 1976 .

[28]  Thomas S. Huang,et al.  A fast two-dimensional median filtering algorithm , 1979 .

[29]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[30]  Cary Scofield,et al.  -d depth-of-field simulation for Computer animation , 1992, Graphics Gems III.