Joint bilateral upsampling

Image analysis and enhancement tasks such as tone mapping, colorization, stereo depth, and photomontage, often require computing a solution (e.g., for exposure, chromaticity, disparity, labels) over the pixel grid. Computational and memory costs often require that a smaller solution be run over a downsampled image. Although general purpose upsampling methods can be used to interpolate the low resolution solution to the full resolution, these methods generally assume a smoothness prior for the interpolation. We demonstrate that in cases, such as those above, the available high resolution input image may be leveraged as a prior in the context of a joint bilateral upsampling procedure to produce a better high resolution solution. We show results for each of the applications above and compare them to traditional upsampling methods.

[1]  Michael Cohen,et al.  Capturing and viewing gigapixel images , 2007, SIGGRAPH 2007.

[2]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[3]  Danny Barash,et al.  A Fundamental Relationship between Bilateral Filtering, Adaptive Smoothing, and the Nonlinear Diffusion Equation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  R. Szeliski Locally adapted hierarchical basis preconditioning , 2006, SIGGRAPH 2006.

[5]  Michael Elad,et al.  On the bilateral filter and ways to improve it , 2002 .

[6]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[7]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[8]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  F. Durand,et al.  A frequency analysis of light transport , 2005, ACM Trans. Graph..

[10]  Keith J. Hanna,et al.  Hybrid stereo camera: an IBR approach for synthesis of very high resolution stereoscopic image sequences , 2001, SIGGRAPH.

[11]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[12]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[13]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, SIGGRAPH 2006.

[14]  George Wolberg,et al.  Digital image warping , 1990 .

[15]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[16]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[17]  Seungjoon Yang,et al.  Bilateral interpolation filters for image size conversion , 2005, IEEE International Conference on Image Processing 2005.

[18]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[19]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[20]  Greg Ward,et al.  High dynamic range imaging , 2001, SIGGRAPH '04.

[21]  Ben Weiss Fast median and bilateral filtering , 2006, SIGGRAPH 2006.

[22]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.