Blind restoration of very-high-ISO photos via low-rank methods

We propose a new algorithm for blind restoration of very-high-ISO photos. Unlike previous methods that sequentially tackle the problem of noise estimation and image denoising, our approach alternatively refines the estimates of latent image and noise level function (NLF). We rigorously show how the existing low-rank based modeling of image prior can be extended to incorporate spatially inhomogeneous and signal-dependent noise. We develop a generalization of singular-value thresholding technique by making the thresh-old/regularization parameter doubly adaptive - adaptive to both local signal and noise variance estimates. Our experimental results have shown that the proposed auto-denoising algorithm is capable of achieving visually pleasant restoration of photos with ISO settings of above 6400 for a wide range of brand cameras and at a moderate computational cost.

[1]  Takeo Kanade,et al.  Statistical calibration of CCD imaging process , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[3]  Hui Ma,et al.  Image Deblurring with Blurred / Noisy Image Pairs , 2013 .

[4]  Guangming Shi,et al.  Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach , 2013, IEEE Transactions on Image Processing.

[5]  L. McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, SIGGRAPH 2005.

[6]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[7]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[8]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[9]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[10]  Shang Xiao,et al.  Adaptive Wavelet Thresholding for Image Denoising , 2003 .

[11]  Lei Zhang,et al.  Sparsity-based image denoising via dictionary learning and structural clustering , 2011, CVPR 2011.

[12]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[14]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[15]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[18]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, ACM Trans. Graph..

[19]  Vladimir V. Lukin,et al.  Local Signal-Dependent Noise Variance Estimation From Hyperspectral Textural Images , 2011, IEEE Journal of Selected Topics in Signal Processing.

[20]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[21]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.