Iteratively merging information from a pair of flash/no-flash images using nonlinear diffusion

In this paper, we present a mechanism based on the guided filter for merging information from a pair of imperfectly exposed images, to produce a better one. The guided filter [7] utilizes information from a guide image to enhance a corrupted input image as similarly done in the joint bilateral filter [3, 12]. Here we analyze the spectral behavior of the guided filter kernel in a matrix formulation and introduce a novel iterative technique which significantly improves it. Iterations of the proposed method consist of a combination of nonlinear anisotropic diffusion and reaction-diffusion. We demonstrate that the proposed approach outperforms state of the art methods in both flash/no-flash restoration where one of the images is significantly noisy or blurry.

[1]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[2]  Narendra Ahuja,et al.  Real-Time Specular Highlight Removal Using Bilateral Filtering , 2010, ECCV.

[3]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[4]  Jian Sun,et al.  Fast matting using large kernel matting Laplacian matrices , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[6]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[7]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[8]  Marie-Paule Cani,et al.  Hierarchical pattern mapping , 2002, ACM Trans. Graph..

[9]  Narendra Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[11]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Frédo Durand,et al.  Non-iterative, feature-preserving mesh smoothing , 2003, ACM Trans. Graph..

[13]  Niklas Nordström.  Biased Anisotropic Diffusion - A Unified Regularization and Diffusion Approach to Edge Detection , 1990, ECCV.

[14]  R. Fergus,et al.  Dark flash photography , 2009, ACM Trans. Graph..

[15]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[16]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[17]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[18]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[19]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[20]  Dong Guo,et al.  Robust flash deblurring , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.