Differential Progressive Path Tracing for High-Quality Previsualization and Relighting in Augmented Reality

In this paper we present a novel method for real-time high quality previsualization and cinematic relighting. The physically based Path Tracing algorithm is used within an Augmented Reality setup to preview high-quality light transport. A novel differential version of progressive path tracing is proposed, which calculates two global light transport solutions that are required for differential rendering. A real-time previsualization framework is presented, which renders the solution with a low number of samples during interaction and allows for progressive quality improvement. If a user requests the high-quality solution of a certain view, the tracking is stopped and the algorithm progressively converges to an accurate solution. The problem of rendering complex light paths is solved by using photon mapping. Specular global illumination effects like caustics can easily be rendered. Our framework utilizes the massive parallel power of modern GPUs to achieve fast rendering with complex global illumination, a depth of field effect, and antialiasing.

[1]  Veronica Teichrieb,et al.  Photorealistic rendering for Augmented Reality: A global illumination and BRDF solution , 2010, 2010 IEEE Virtual Reality Conference (VR).

[2]  Manuel Menezes de Oliveira Neto,et al.  Adaptive manifolds for real-time high-dimensional filtering , 2012, ACM Trans. Graph..

[3]  Martin Knecht,et al.  Differential Instant Radiosity for mixed reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[4]  Li Li,et al.  Photorealistic rendering for augmented reality using environment illumination , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[5]  David A. Forsyth,et al.  Rendering synthetic objects into legacy photographs , 2011, ACM Trans. Graph..

[6]  Timo Aila,et al.  PantaRay: fast ray-traced occlusion caching of massive scenes , 2010, SIGGRAPH 2010.

[7]  Francesco Banterle,et al.  Inverse tone mapping , 2006, GRAPHITE '06.

[8]  Hannes Kaufmann,et al.  High-quality reflections, refractions, and caustics in Augmented Reality and their contribution to visual coherence , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[9]  Per H. Christensen,et al.  Multiresolution radiosity caching for global illumination in movies , 2012, SIGGRAPH Talks.

[10]  Hannes Kaufmann,et al.  Physically-Based Depth of Field in Augmented Reality , 2012, Eurographics.

[11]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[12]  Paul Debevec Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[13]  Kunihiro Chihara,et al.  Real-time outdoor pre-visualization method for videographers —real-time geometric registration using point-based model— , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[14]  James T. Kajiya,et al.  The rendering equation , 1998 .

[15]  Thorsten Grosch,et al.  Differential Photon Mapping - Consistent Augmentation of Photographs with Correction of all Light Paths , 2005, Eurographics.

[16]  Thorsten Grosch,et al.  Consistent interactive augmentation of live camera images with correct near-field illumination , 2007, VRST '07.

[17]  Craig S. Kaplan,et al.  A collaborative real time previsualization tool for video games and film , 2012, SIGGRAPH '12.

[18]  H. Jensen Realistic Image Synthesis Using Photon Mapping , 2001 .

[19]  David K. McAllister,et al.  OptiX: a general purpose ray tracing engine , 2010, ACM Trans. Graph..

[20]  Philipp Lensing,et al.  Instant indirect illumination for dynamic mixed reality scenes , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[21]  Hock Hian Wong Previsualization: assisting filmmakers in realizing their vision , 2012, SA '12.