An Algorithm for Rendering Generalized Depth of Field Effects Based on Simulated Heat Diffusion

Depth of field refers to the swath through a 3D scene that is imaged in acceptable focus through an optics system, such as a camera lens. Control over depth of field is an important artistic tool that can be used to emphasize the subject of a photograph. In a real camera, the control over depth of field is limited by the nature of the image formation process and by physical constraints. The depth of field effect has been simulated in computer graphics, but with the same limited control as found in real camera lenses. In this paper, we use diffusion in a non-homogeneous medium to generalize depth of field in computer graphics by enabling the user to independently specify the degree of blur at each point in three-dimensional space. Generalized depth of field provides a novel tool to emphasize an area of interest within a 3D scene, to pick objects out of a crowd, and to render a busy, complex picture more understandable by focusing only on relevant details that may be scattered throughout the scene. Our algorithm operates by blurring a sequence of nonplanar layers that form the scene. Choosing a suitable blur algorithm for the layers is critical; thus, we develop appropriate blur semantics such that the blur algorithm will properly generalize depth of field. We found that diffusion in a non-homogeneous medium is the process that best suits these semantics.

[1]  Cary Scofield,et al.  -d depth-of-field simulation for Computer animation , 1992, Graphics Gems III.

[2]  Sidney F. Ray,et al.  Applied Photographic Optics: Lenses and optical systems for photography, film, video, electronic and digital imaging , 2002 .

[3]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[4]  Marcelo Bertalmío,et al.  Real-time, accurate depth of field using anisotropic diffusion and programmable graphics cards , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[5]  Norman Goldberg Camera Technology: The Dark Side of the Lens , 1992 .

[6]  RokitaPrzemyslaw Generating Depth-of-Field Effects in Virtual Reality Applications , 1996 .

[7]  Sidney Ray,et al.  Applied photographic optics , 1998 .

[8]  Brian A. Barsky Vision-realistic rendering: simulation of the scanned foveal image from wavefront data of human subjects , 2004, APGV '04.

[9]  Irene T. Weber,et al.  Emphasizing the area of interest using real-time shaders , 2005, SIGGRAPH '05.

[10]  Hans-Peter Seidel,et al.  An Image-Based Model for Realistic Lens Systems in Interactive Computer Graphics , 1997, Graphics Interface.

[11]  Paul Fearing Importance Ordering for Real-Time Depth of Field , 1995, ICSC.

[12]  Heinrich H. Bülthoff,et al.  Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization, APGV 2004, Los Angeles, California, USA, August 7-8, 2004 , 2004, APGV.

[13]  Frédo Durand,et al.  De-emphasis of distracting image regions using texture power maps , 2005, APGV '05.

[14]  Michael Potmesil,et al.  Synthetic Image Generation with a Lens and Aperture Camera Model , 1982, TOGS.

[15]  L. Rosenhead Conduction of Heat in Solids , 1947, Nature.

[16]  Ren Ng Fourier slice photography , 2005, ACM Trans. Graph..

[17]  Marina L. Gavrilova,et al.  Computational Science and Its Applications — ICCSA 2003 , 2003 .

[18]  Brian A. Barsky,et al.  Elimination of artifacts due to occlusion and discretization problems in image space blurring techniques , 2005, Graph. Model..

[19]  Mark A. Z. Dippé,et al.  Antialiasing through stochastic sampling , 1985, SIGGRAPH.

[20]  Jitendra Malik,et al.  A network for multiscale image segmentation , 1988, 1988., IEEE International Symposium on Circuits and Systems.

[21]  Richard D. Zakia,et al.  Basic Photographic Materials and Processes , 1986 .

[22]  Eduard Gröller,et al.  Nonlinear ray tracing: Visualizing strange worlds , 1995, The Visual Computer.

[23]  Clay Budin zDOF: a fast, physically accurate algorithm for simulating depth-of-field effects in synthetic images using z-buffers , 2004, SIGGRAPH '04.

[24]  David B. Kirk,et al.  Graphics Gems III , 1992 .

[25]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part II, Image-Based Techniques , 2003, ICCSA.

[26]  Ben J Hicks,et al.  SPIE - The International Society for Optical Engineering , 2001 .

[27]  Brian A. Barsky,et al.  Rendering skewed plane of sharp focus and associated depth of field , 2004, SIGGRAPH '04.

[28]  Silvia Miksch,et al.  Semantic depth of field , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[29]  Marc Levoy,et al.  Synthetic aperture confocal imaging , 2004, SIGGRAPH 2004.

[30]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[31]  Adam W. Bargteil,et al.  Introducing Vision-Realistic Rendering , 2002 .

[32]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[33]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part I, Object-Based Techniques , 2003, ICCSA.

[34]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[35]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[36]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[37]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[38]  E LeeMark,et al.  Statistically optimized sampling for distributed ray tracing , 1985 .

[39]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[40]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[41]  J. C. Jaeger,et al.  Conduction of Heat in Solids , 1952 .

[42]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[43]  Jirí Zára,et al.  Fast depth of field rendering with surface splatting , 2003, Proceedings Computer Graphics International 2003.

[44]  Francis Arthur Jenkins,et al.  Fundamentals of Optics , 1976 .

[45]  Thomas Ertl,et al.  GPU‐Based Nonlinear Ray Tracing , 2004, Comput. Graph. Forum.

[46]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Leslie D. Stroebel View Camera Technique , 1976 .

[48]  Jim Stone A User's Guide to the View Camera: Third Edition , 1987 .

[49]  Rudolf Kingslake,et al.  Optics in photography , 1992 .

[50]  Przemyslaw Rokita,et al.  Generating depth of-field effects in virtual reality applications , 1996, IEEE Computer Graphics and Applications.

[51]  F. Kenton Musgrave,et al.  A note on ray tracing mirages (comments and author's reply) , 1990, IEEE Computer Graphics and Applications.

[52]  Bill Erickson,et al.  Professional Digital Photography , 1999 .

[53]  J. Dunn,et al.  Basic Photographic Materials and Processes , 1986 .

[54]  Brian A. Barsky,et al.  Investigating Occlusion and Discretization Problems in Image-Based Blurring Techniques , 2003, VVG.