Motion Blur Rendering: State of the Art

Motion blur is a fundamental cue in the perception of objects in motion. This phenomenon manifests as a visible trail along the trajectory of the object and is the result of the combination of relative motion and light integration taking place in film and electronic cameras. In this work, we analyse the mechanisms that produce motion blur in recording devices and the methods that can simulate it in computer generated images. Light integration over time is one of the most expensive processes to simulate in high‐quality renders, as such, we make an in‐depth review of the existing algorithms and we categorize them in the context of a formal model that highlights their differences, strengths and limitations. We finalize this report proposing a number of alternative classifications that will help the reader identify the best technique for a particular scenario.

[1]  Hans-Peter Seidel,et al.  An efficient spatio-temporal architecture for animation rendering , 2003, SIGGRAPH '03.

[2]  Don P. Mitchell,et al.  Spectrally optimal sampling for distribution ray tracing , 1991, SIGGRAPH.

[3]  Douglas Green,et al.  An open and shut case? , 2013, Journal of the American College of Radiology : JACR.

[4]  Arie E. Kaufman,et al.  High-degree temporal antialiasing , 2000, Proceedings Computer Animation 2000.

[5]  Andrew Glassner Celtic Knots, Part 2 , 1999, IEEE Computer Graphics and Applications.

[6]  Marc M. Van Hulle,et al.  Realtime phase-based optical flow on the GPU , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Robert L. Cook,et al.  The Reyes image rendering architecture , 1987, SIGGRAPH.

[8]  Donald P. Greenberg,et al.  Interactive global illumination in dynamic scenes , 2002, SIGGRAPH.

[9]  Andrew S. Glassner An Open and Shut Case , 1999, IEEE Computer Graphics and Applications.

[10]  Karol Myszkowski,et al.  Perception-based global illumination, rendering, and animation techniques , 2002, SCCG '02.

[11]  Lance Williams Pyramidal parametrics , 1998 .

[12]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[13]  Ingo Wald,et al.  State of the Art in Ray Tracing Animated Scenes , 2009, Comput. Graph. Forum.

[14]  M. Akke,et al.  An open and shut case , 2001, Nature Structural Biology.

[15]  F. Durand,et al.  A frequency analysis of light transport , 2005, ACM Trans. Graph..

[16]  Philippe Bekaert,et al.  Advanced global illumination , 2006 .

[17]  D. G. Green,et al.  Optical and retinal factors affecting visual resolution. , 1965, The Journal of physiology.

[18]  Yves D. Willems,et al.  Bi-directional path tracing , 1993 .

[19]  James Arvo,et al.  Monte Carlo Ray Tracing , 2003 .

[20]  J D Mollon,et al.  The independence of the temporal integration properties of individual chromatic mechanisms in the human eye , 1971, The Journal of physiology.

[21]  Marc Levoy,et al.  Synthetic texturing using digital filters , 1980, SIGGRAPH '80.

[22]  Adam Arbree,et al.  To appear in the ACM SIGGRAPH conference proceedings Lightcuts: A Scalable Approach to Illumination , 2022 .

[23]  Markus H. Gross,et al.  Programmable motion effects , 2010, ACM Trans. Graph..

[24]  Kun Zhou,et al.  Micropolygon ray tracing with defocus and motion blur , 2010 .

[25]  Markus Gross,et al.  Programmable motion effects , 2010, SIGGRAPH 2010.

[26]  E. J. S. Zagier Defining and Refining Frameless Rendering , 1996 .

[27]  D. Burr Motion smear , 1980, Nature.

[28]  Meng Yu,et al.  Camera Models and Optical Systems Used in Computer Graphics: Part I, Object-Based Techniques , 2003, ICCSA.

[29]  Carlo H. Séquin,et al.  Tapestry: A Dynamic Mesh-based Display Representation for Interactive Rendering , 2000, Rendering Techniques.

[30]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics) , 2005 .

[31]  Michael Potmesil,et al.  A lens and aperture camera model for synthetic image generation , 1981, SIGGRAPH '81.

[32]  Norman I. Badler,et al.  Temporal anti-aliasing in computer generated animation , 1983, SIGGRAPH.

[33]  Benjamin Watson,et al.  Adaptive frameless rendering , 2005, EGSR '05.

[34]  Robert L. Cook,et al.  Distributed ray tracing , 1984, SIGGRAPH.

[35]  Leonidas J. Guibas,et al.  Bidirectional Estimators for Light Transport , 1995 .

[36]  Ronald Pose,et al.  Priority rendering with a virtual reality address recalculation pipeline , 1994, SIGGRAPH.

[37]  Ron Brinkmann,et al.  The Art and Science of Digital Compositing , 1999 .

[38]  Baoquan Chen,et al.  Hardware Accelerated Motion Blur Generation , 2006 .

[39]  Edwin E. Catmull,et al.  An analytic visible surface algorithm for independent pixel processing , 1984, SIGGRAPH.

[40]  David S. Ebert,et al.  Texturing and modeling - a procedural approach, Third Edition , 2002, Morgan Kaufmann series in computer graphics and geometric modeling.

[41]  Duc Quang Nguyen,et al.  Physically based modeling and animation of fire , 2002, ACM Trans. Graph..

[42]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[43]  Ronald Fedkiw,et al.  Visual simulation of smoke , 2001, SIGGRAPH.

[44]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[45]  K. Bala,et al.  Multidimensional lightcuts , 2006, SIGGRAPH 2006.

[46]  Henry Fuchs,et al.  Frameless rendering: double buffering considered harmful , 1994, SIGGRAPH.

[47]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[48]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[49]  Frédo Durand,et al.  Frequency analysis and sheared reconstruction for rendering motion blur , 2009, SIGGRAPH 2009.

[50]  Michael Potmesil,et al.  Modeling motion blur in computer-generated images , 1983, SIGGRAPH.

[51]  Kun Zhou,et al.  RenderAnts: interactive Reyes rendering on GPUs , 2009, SIGGRAPH 2009.

[52]  Benjamin Watson,et al.  Interruptible rendering , 2002, SIGGRAPH '02.

[53]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[54]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[55]  Thomas Röfer,et al.  Real-Time Simulation of Motion-Based Camera Disturbances , 2009, RoboCup.

[56]  Crow,et al.  A Comparison of Antialiasing Techniques , 1981, IEEE Computer Graphics and Applications.

[57]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[58]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[59]  Richard Zakia,et al.  Photographic Sensitometry: The Study of Tone Reproduction , 1969 .

[60]  Jörn Loviscach,et al.  Motion blur for textures by means of anisotropic filtering , 2005, EGSR '05.

[61]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[62]  R. Ramamoorthi,et al.  Adaptive wavelet rendering , 2009, SIGGRAPH 2009.

[63]  Pat Hanrahan,et al.  Hardware implementation of micropolygon rasterization with motion and defocus blur , 2010, HPG '10.

[64]  Parag A. Pathak,et al.  Massachusetts Institute of Technology , 1964, Nature.

[65]  Tom Lokovic,et al.  Deep shadow maps , 2000, SIGGRAPH.

[66]  Pat Hanrahan,et al.  Space-time hierarchical occlusion culling for micropolygon rendering with motion blur , 2010, HPG '10.

[67]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[68]  Benjamin Watson,et al.  Improving frameless rendering by focusing on change , 2002, SIGGRAPH '02.

[69]  Andrew S. Glassner,et al.  Spacetime ray tracing for animation , 1988, IEEE Computer Graphics and Applications.

[70]  Adam Arbree,et al.  Multidimensional lightcuts , 2006, ACM Trans. Graph..

[71]  M. Lévesque Perception , 1986, The Yale Journal of Biology and Medicine.

[72]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[73]  D A Atchison,et al.  The Effect of Pupil Size on Visual Acuity in Uncorrected and Corrected Myopia , 1979, American journal of optometry and physiological optics.

[74]  K. Bala,et al.  Lightcuts: a scalable approach to illumination , 2005, SIGGRAPH 2005.

[75]  Brian A. Barsky,et al.  Algorithms for rendering depth of field effects in computer graphics , 2008 .

[76]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[77]  Kun Zhou,et al.  RenderAnts: interactive Reyes rendering on GPUs , 2009, SIGGRAPH 2009.

[78]  George Drettakis,et al.  Interactive Rendering using the Render Cache , 1999, Rendering Techniques.

[79]  Kun Zhou,et al.  Micropolygon ray tracing with defocus and motion blur , 2010, SIGGRAPH 2010.

[80]  Hyeong-Seok Ko,et al.  Eulerian Motion Blur , 2007, NPH.

[81]  Natalya Tatarchuk,et al.  Motion Blur Using Geometry and Shading Distortion , 2004 .

[82]  J. Yellott Spectral analysis of spatial sampling by photoreceptors: Topological disorder prevents aliasing , 1982, Vision Research.

[83]  Paul S. Heckbert,et al.  Survey of Texture Mapping , 1986, IEEE Computer Graphics and Applications.

[84]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[85]  Marc Olano,et al.  Combatting rendering latency , 1995, I3D '95.

[86]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[87]  Mikio Shinya Spatial anti-aliasing for animation sequences with spatio-temporal filtering , 1993, SIGGRAPH.

[88]  D. H. Kelly Spatio-temporal frequency characteristics of color-vision mechanisms* , 1974 .

[89]  C. Enroth-Cugell,et al.  Chapter 9 Visual adaptation and retinal gain controls , 1984 .

[90]  Frédo Durand,et al.  Frequency analysis and sheared reconstruction for rendering motion blur , 2009, ACM Trans. Graph..

[91]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[92]  P.H. Christensen,et al.  Ray Tracing for the Movie `Cars' , 2006, 2006 IEEE Symposium on Interactive Ray Tracing.

[93]  Leonidas J. Guibas,et al.  Metropolis light transport , 1997, SIGGRAPH.

[94]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[95]  Deepa Kundur,et al.  Blind Image Deconvolution , 2001 .

[96]  Diego Gutierrez,et al.  Efficient selective rendering of participating media , 2006, APGV '06.

[97]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[98]  Klaus Mueller,et al.  Point-based Surface Rendering with Motion Blur , 2004, PBG.

[99]  Rachel McDonnell,et al.  Perceptually Adaptive Graphics , 2004, Eurographics.

[100]  Tomas Akenine-Möller,et al.  Stochastic rasterization using time-continuous triangles , 2007, GH '07.

[101]  Huei-Yung Lin,et al.  Photo-Consistent Motion Blur Modeling for Realistic Image Synthesis , 2006, PSIVT.

[102]  Robert C. Zeleznik,et al.  Interactive real-time motion blur , 2005, The Visual Computer.

[103]  Ellen J. Scher Zagier A human's eye view: motion blur and frameless rendering , 1997, CROS.

[104]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[105]  Yoshiki Mizukami,et al.  Optical Flow Computation on Compute Unified Device Architecture , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[106]  John Keyser,et al.  Real-time geometric motion blur for a deforming polygonal mesh , 2005, International 2005 Computer Graphics.

[107]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[108]  Charles W. Grant,et al.  Integrated analytic spatial and temporal anti-aliasing for polyhedra in 4-space , 1985, SIGGRAPH.

[109]  Jaakko Lehtinen,et al.  Decoupled Sampling for Real-Time Graphics Pipelines , 2010 .

[110]  R. Shack The Influence of Image Motion and Shutter Operation on the Photographic Transfer Function , 1964 .

[111]  Joe Geigel,et al.  A model for simulating the photographic development process on digital images , 1997, SIGGRAPH.

[112]  Wolfgang Engel ShaderX2: Shader Programming Tips and Tricks with DirectX 9.0 , 2003 .

[113]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[114]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[115]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[116]  Edwin E. Catmull,et al.  A hidden-surface algorithm with anti-aliasing , 1978, SIGGRAPH.

[117]  David S. Ebert,et al.  Texturing and Modeling, Third Edition: A Procedural Approach (The Morgan Kaufmann Series in Computer Graphics) , 2011 .

[118]  Irfan A. Essa,et al.  Image-based motion blur for stop motion animation , 2001, SIGGRAPH.

[119]  Ellen J. Scher Zagier,et al.  A human's eye view: motion blur and frameless rendering , 1997, CROS.

[120]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[121]  Leonidas J. Guibas,et al.  Robust Monte Carlo methods for light transport simulation , 1997 .

[122]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[123]  Philippe Bekaert,et al.  Advanced Global Illumination, Second Edition , 2006 .

[124]  Nelson L. Max,et al.  A two-and-a-half-D motion-blur algorithm , 1985, SIGGRAPH '85.

[125]  Arun N. Netravali,et al.  Reconstruction filters in computer-graphics , 1988, SIGGRAPH.

[126]  Alyn P. Rockwood,et al.  Clamping: A method of antialiasing textured surfaces by bandwidth limiting in object space , 1982, SIGGRAPH.

[127]  Mark A. Z. Dippé,et al.  Antialiasing through stochastic sampling , 1985, SIGGRAPH.

[128]  Karol Myszkowski,et al.  State of the Art in Global Illumination for Interactive Applications and High‐quality Animations , 2003, Comput. Graph. Forum.

[129]  Pat Hanrahan,et al.  Data-parallel rasterization of micropolygons with defocus and motion blur , 2009, High Performance Graphics.

[130]  S. Shankar Sastry,et al.  Geometric Models of Rolling-Shutter Cameras , 2005, ArXiv.

[131]  Kelvin Sung,et al.  Spatial-Temporal Antialiasing , 2002, IEEE Trans. Vis. Comput. Graph..

[132]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .

[133]  Jason Lawrence,et al.  Accelerating real-time shading with reverse reprojection caching , 2007, GH '07.

[134]  Brian A. Barsky,et al.  Advanced Renderman: Creating CGI for Motion Pictures , 1999 .

[135]  Eric P. Lafortune,et al.  Mathematical Models and Monte Carlo Algorithms for Physically Based Rendering , 1995 .

[136]  Tim Weyrich,et al.  Motion Blur for EWA Surface Splatting , 2010, Comput. Graph. Forum.

[137]  Mike Cammarano,et al.  Time Dependent Photon Mapping , 2002, Rendering Techniques.

[138]  U. Rüde,et al.  Enhanced Motion Blur Calculation with Optical Flow , 2006 .

[139]  Klaus Mueller,et al.  Splatting Errors and Antialiasing , 1998, IEEE Trans. Vis. Comput. Graph..

[140]  Anne Sullivan,et al.  Synthetic Shutter Speed Imaging , 2007, Comput. Graph. Forum.

[141]  Matthias Zwicker,et al.  Surface splatting , 2001, SIGGRAPH.

[142]  Don P. Mitchell,et al.  Consequences of stratified sampling in graphics , 1996, SIGGRAPH.

[143]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[144]  Ryan Meredith-Jones Point-sampling algorithms for simulating motion blur , 2000 .

[145]  David Salesin,et al.  Rendering antialiased shadows with depth maps , 1987, SIGGRAPH.

[146]  Pedro V. Sander,et al.  Chapter 10 Computation Culling with Explicit Early-Z and Dynamic Flow Control , 2005 .

[147]  Samuel P. Uselton,et al.  Statistically optimized sampling for distributed ray tracing , 1985, SIGGRAPH.

[148]  Lance Williams,et al.  Pyramidal parametrics , 1983, SIGGRAPH.