Dynamic feathering: Minimising blending artefacts in view-dependent rendering

Conventional view-dependent texture mapping techniques produce composite images by blending subsets of input images, weighted according to their relative influence at the rendering viewpoint, over regions where the views overlap. Geometric or camera calibration errors often result in a los s of detail due to blurring or double exposure artefacts which tends to be exacerbated by the number of blending views considered. We propose a novel view-dependent rendering technique which optimises the blend region dynamically at rendering time, and reduces the adverse effects of camera calibration or geometric errors otherwise observed. The technique has been successfully integrated in a rendering pipeline which operates at interactive frame rates. Improvement over state-of-the-art view-dependent texture mapping techniques are illustrated on a synthetic scene as well as real imagery of a large scale outdoor scene where large camera calibration and geometric errors are present. (10 pages)

[1]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[2]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[3]  Kok-Lim Low,et al.  Blending multiple views , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[4]  Jean-Michel Dischler,et al.  Real-time high-quality View-Dependent Texture Mapping using per-pixel visibility , 2005, GRAPHITE.

[5]  Petros Maragos,et al.  Optimum design of chamfer distance transforms , 1998, IEEE Trans. Image Process..

[6]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[7]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[8]  Oliver Grau,et al.  A Bayesian Framework for Simultaneous Matting and 3D Reconstruction , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[9]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Reinhard Koch,et al.  Image Based Interactive Rendering with View Dependent Geometry , 2003, Comput. Graph. Forum.

[11]  Mohammad H. Mahoor,et al.  Fast image blending using watersheds and graph cuts , 2009, Image Vis. Comput..

[12]  Linda G. Shapiro,et al.  View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data , 1997, Rendering Techniques.

[13]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[14]  Jean-Michel Dischler,et al.  Real-time per-pixel viewpoint interpolation , 2004, Proceedings Theory and Practice of Computer Graphics, 2004..

[15]  Harry Shum,et al.  Review of image-based rendering techniques , 2000, Visual Communications and Image Processing.

[16]  Maarten Vergauwen,et al.  Real-time image based rendering from uncalibrated images , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[17]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[18]  Tsuhan Chen,et al.  A survey on image-based rendering - representation, sampling and compression , 2004, Signal Process. Image Commun..

[19]  G. Willems,et al.  Image-based rendering for photo-realistic visualization , 2006 .

[20]  Yu Meng,et al.  Dmesh: Fast Depth-Image Meshing And Warping , 2004, Int. J. Image Graph..