Iterative Image Warping

Animated image sequences often exhibit a large amount of inter‐frame coherence which standard rendering algorithms and pipelines are ill‐equipped to exploit, limiting their efficiency. To address this inefficiency we transfer rendering results across frames using a novel image warping algorithm based on fixed point iteration. We analyze the behavior of the iteration and describe two alternative algorithms designed to suit different performance requirements. Further, to demonstrate the versatility of our approach we apply it to a number of spatio‐temporal rendering problems including 30‐to‐60Hz frame upsampling, stereoscopic 3D conversion, defocus and motion blur. Finally we compare our approach against existing image warping methods and demonstrate a significant performance improvement.

[1]  Wolfgang Stuerzlinger,et al.  A Three Dimensional Image Cache for Virtual Reality , 1996, Comput. Graph. Forum.

[2]  S. Tachi,et al.  Detailed Shape Representation with Parallax Mapping , 2001 .

[3]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[4]  Huw Bowles.  Efficient Real-Time Stereoscopic 3D Rendering , 2010 .

[5]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[6]  Alexander Reshetov.  Morphological antialiasing , 2009, High Performance Graphics.

[7]  Dmitry Andreev,et al.  Real-time frame rate up-conversion for video games: or how to get from 30 to 60 fps for "free" , 2010, SIGGRAPH '10.

[8]  Jason Lawrence,et al.  Accelerating real-time shading with reverse reprojection caching , 2007, GH '07.

[9]  Hans-Peter Seidel,et al.  Adaptive Image-space Stereo View Synthesis , 2010, VMV.

[10]  Hans-Peter Seidel,et al.  Perceptually‐motivated Real‐time Temporal Upsampling of 3D Content for High‐refresh‐rate Displays , 2010, Comput. Graph. Forum.

[11]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[12]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[13]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[14]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[15]  Nelson L. Max,et al.  Hierarchical Rendering of Trees from Precomputed Multi-Layer Z-Buffers , 1996, Rendering Techniques.

[16]  Robert W. Marcato.  Optimizing an inverse warper , 1998 .

[17]  Matthias Zwicker,et al.  3 Ideal Resampling 3 . 1 Sampling and Aliasing , 2022 .

[18]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[19]  Lei Yang,et al.  Image-based bidirectional scene reprojection , 2011, ACM Trans. Graph..

[20]  Justin Hensley,et al.  Real‐Time Concurrent Linked List Construction on the GPU , 2010, Comput. Graph. Forum.

[21]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[22]  George Drettakis,et al.  Interactive Rendering using the Render Cache , 1999, Rendering Techniques.

[23]  Jay Torborg,et al.  Talisman: commodity realtime 3D graphics for the PC , 1996, SIGGRAPH.

[24]  Weiguo Lu,et al.  A simple fixed-point approach to invert a deformation field. , 2007, Medical physics.

[25]  George Drettakis,et al.  Enhancing and Optimizing the Render Cache , 2002, Rendering Techniques.

[26]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[27]  Jason Lawrence,et al.  An improved shading cache for modern GPUs , 2008, GH '08.