Frequency analysis and sheared reconstruction for rendering motion blur

Motion blur is crucial for high-quality rendering, but is also very expensive. Our first contribution is a frequency analysis of motion-blurred scenes, including moving objects, specular reflections, and shadows. We show that motion induces a shear in the frequency domain, and that the spectrum of moving scenes can be approximated by a wedge. This allows us to compute adaptive space-time sampling rates, to accelerate rendering. For uniform velocities and standard axis-aligned reconstruction, we show that the product of spatial and temporal bandlimits or sampling rates is constant, independent of velocity. Our second contribution is a novel sheared reconstruction filter that is aligned to the first-order direction of motion and enables even lower sampling rates. We present a rendering algorithm that computes a sheared reconstruction filter per pixel, without any intermediate Fourier representation. This often permits synthesis of motion-blurred images with far fewer rendering samples than standard techniques require.

[1]  Frédo Durand,et al.  Motion-invariant photography , 2008, SIGGRAPH 2008.

[2]  Mike Cammarano,et al.  Time Dependent Photon Mapping , 2002, Rendering Techniques.

[3]  Ravi Ramamoorthi,et al.  A first-order analysis of lighting, shading, and shadows , 2007, TOGS.

[4]  Ravi Ramamoorthi,et al.  A Fourier theory for cast shadows , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[6]  Edwin E. Catmull,et al.  An analytic visible surface algorithm for independent pixel processing , 1984, SIGGRAPH.

[7]  Richard Peter Weistroffer,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, SIGGRAPH 2008.

[8]  Frédo Durand,et al.  Fourier depth of field , 2009, TOGS.

[9]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[10]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[11]  Don P. Mitchell,et al.  Spectrally optimal sampling for distribution ray tracing , 1991, SIGGRAPH.

[12]  Robert L. Cook,et al.  The Reyes image rendering architecture , 1987, SIGGRAPH.

[13]  F. Durand,et al.  A frequency analysis of light transport , 2005, ACM Trans. Graph..

[14]  Kelvin Sung,et al.  Spatial-Temporal Antialiasing , 2002, IEEE Trans. Vis. Comput. Graph..

[15]  Frédo Durand,et al.  Motion-invariant photography , 2008, ACM Trans. Graph..

[16]  Ravi Ramamoorthi,et al.  A theory of locally low dimensional light transport , 2007, SIGGRAPH 2007.

[17]  Tomas Akenine-Möller,et al.  Stochastic rasterization using time-continuous triangles , 2007, GH '07.

[18]  Ravi Ramamoorthi,et al.  A Fourier Theory for Cast Shadows , 2004, ECCV.

[19]  J. Halton On the efficiency of certain quasi-random sequences of points in evaluating multi-dimensional integrals , 1960 .

[20]  François X. Sillion,et al.  Fast calculation of soft shadow textures using convolution , 1998, SIGGRAPH.

[21]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[22]  Michael Potmesil,et al.  Modeling motion blur in computer-generated images , 1983, SIGGRAPH.

[23]  Jörn Loviscach,et al.  Motion blur for textures by means of anisotropic filtering , 2005, EGSR '05.

[24]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[25]  Norman I. Badler,et al.  Temporal anti-aliasing in computer generated animation , 1983, SIGGRAPH.

[26]  Robert L. Cook,et al.  Distributed ray tracing , 1984, SIGGRAPH.

[27]  Nelson L. Max,et al.  A two-and-a-half-D motion-blur algorithm , 1985, SIGGRAPH '85.

[28]  Frédo Durand,et al.  A frequency analysis of light transport , 2005, SIGGRAPH '05.

[29]  Ira Kemelmacher-Shlizerman,et al.  A theory of locally low dimensional light transport , 2007, ACM Trans. Graph..

[30]  K. Bala,et al.  Multidimensional lightcuts , 2006, SIGGRAPH 2006.

[31]  William J. Christmas Spatial Filtering Requirements for Gradient-Based Optical Flow Measurement , 1998, BMVC.