LLSURE: Local Linear SURE-Based Edge-Preserving Image Filtering

In this paper, we propose a novel approach for performing high-quality edge-preserving image filtering. Based on a local linear model and using the principle of Stein's unbiased risk estimate as an estimator for the mean squared error from the noisy image only, we derive a simple explicit image filter which can filter out noise while preserving edges and fine-scale details. Moreover, this filter has a fast and exact linear-time algorithm whose computational complexity is independent of the filtering kernel size; thus, it can be applied to real time image processing tasks. The experimental results demonstrate the effectiveness of the new filter for various computer vision applications, including noise reduction, detail smoothing and enhancement, high dynamic range compression, and flash/no-flash denoising.

[1]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[2]  Thierry Blu,et al.  The SURE-LET Approach to Image Denoising , 2007, IEEE Transactions on Image Processing.

[3]  Onur G. Guleryuz,et al.  Weighted Averaging for Denoising With Overcomplete Dictionaries , 2007, IEEE Transactions on Image Processing.

[4]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[5]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[6]  Charles-Alban Deledalle,et al.  Non-local Methods with Shape-Adaptive Patches (NLM-SAP) , 2012, Journal of Mathematical Imaging and Vision.

[7]  Thierry Blu,et al.  A New SURE Approach to Image Denoising: Interscale Orthonormal Wavelet Thresholding , 2007, IEEE Transactions on Image Processing.

[8]  Jörg Weule,et al.  Non-Linear Gaussian Filters Performing Edge Preserving Diffusion , 1995, DAGM-Symposium.

[9]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[10]  C. Stein.  Estimation of the Mean of a Multivariate Normal Distribution , 1981 .

[11]  Peyman Milanfar,et al.  Patch-Based Near-Optimal Image Denoising , 2012, IEEE Transactions on Image Processing.

[12]  Thierry Blu,et al.  SURE-LET Multichannel Image Denoising: Interscale Orthonormal Wavelet Thresholding , 2008, IEEE Transactions on Image Processing.

[13]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[14]  Amel Benazza-Benyahia,et al.  A Nonlinear Stein-Based Estimator for Multichannel Image Denoising , 2007, IEEE Transactions on Signal Processing.

[15]  Dimitri Van De Ville,et al.  Nonlocal Means With Dimensionality Reduction and SURE-Based Parameter Selection , 2011, IEEE Transactions on Image Processing.

[16]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[17]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[18]  Amel Benazza-Benyahia,et al.  Building robust wavelet estimators for multicomponent images using Stein's principle , 2005, IEEE Transactions on Image Processing.

[19]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[21]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[22]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[23]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[24]  Yann Strozecki,et al.  From patches to pixels in Non-Local methods: Weighted-average reprojection , 2010, 2010 IEEE International Conference on Image Processing.

[25]  Raanan Fattal,et al.  Edge-avoiding wavelets and their applications , 2009, ACM Trans. Graph..

[26]  Dimitri Van De Ville,et al.  SURE-Based Non-Local Means , 2009, IEEE Signal Processing Letters.

[27]  Yann Strozecki,et al.  Patch reprojections for Non-Local methods , 2012, Signal Process..

[28]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, SIGGRAPH 2006.

[29]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[30]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[31]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[32]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[33]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[34]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[35]  Narendra Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[37]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[38]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[40]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[41]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.