An adaptive rank-sparsity K-SVD algorithm for image sequence denoising

Abstract In this paper, we propose an algorithm for the removal of additive white Gaussian noise (AWGN) from a given image sequence. By extending a frame in the spatial and temporal dimensions, the sequence is transformed into the volumetric data in which each frame includes both the spatial and temporal correlation. Image sequence denoising is then formulated as an optimization problem that can be iteratively solved by constructing a rank-sparsity representation on a propagated dictionary. The proposed algorithm effectively trains this dictionary by adaptively determining the required number of iterations. Restoration of the volumetric data is adaptively determined in terms of the noise level. The results on some standard data sets show that the proposed algorithm outperforms the K-singular value decomposition (K-SVD) algorithm and the sparse K-SVD algorithm. If a sequence is characterized by global motion (the moving objects in a scene with similar trajectories, i.e., they moves as a unit) or high motion activity, the performance of the proposed algorithm is comparable to that of block-matching and 4-D filtering (BM4D) and video block-matching and 4-D filtering (V-BM4D).

[1]  Patrick Bouthemy,et al.  An adaptive statistical method for denoising 4D fluorescence image sequences with preservation of spatio-temporal discontinuities , 2005, IEEE International Conference on Image Processing 2005.

[2]  Angshul Majumdar,et al.  Non-convex algorithm for sparse and low-rank recovery: application to dynamic MRI reconstruction. , 2013, Magnetic resonance imaging.

[3]  Patrick Bouthemy,et al.  Patch-Based Nonlocal Functional for Denoising Fluorescence Microscopy Image Sequences , 2010, IEEE Transactions on Medical Imaging.

[4]  Lizhi Cheng,et al.  Image inpainting based on low-rank and joint-sparse matrix recovery , 2013 .

[5]  Yskandar Hamam,et al.  Bilateral mesh filtering , 2012, Pattern Recognit. Lett..

[6]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[7]  O. Lepskii.  Asymptotically Minimax Adaptive Estimation. I: Upper Bounds. Optimally Adaptive Estimates , 1992 .

[8]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[9]  Aleksandra Pizurica,et al.  Wavelet-Domain Video Denoising Based on Reliability Measures , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[11]  Lars Kai Hansen,et al.  Sparse non-linear denoising: Generalization performance and pattern reproducibility in functional MRI , 2011, Pattern Recognit. Lett..

[12]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[13]  Pablo A. Parrilo,et al.  Rank-Sparsity Incoherence for Matrix Decomposition , 2009, SIAM J. Optim..

[14]  Peyman Milanfar,et al.  Clustering-Based Denoising With Locally Learned Dictionaries , 2009, IEEE Transactions on Image Processing.

[15]  Michael Elad,et al.  Image Denoising Via Learned Dictionaries and Sparse representation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  Jean-Michel Morel,et al.  Denoising image sequences does not require motion estimation , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[17]  Jean-Michel Morel,et al.  Image Denoising Methods. A New Nonlocal Principle , 2010, SIAM Rev..

[18]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[19]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[20]  Licheng Jiao,et al.  An efficient matrix factorization based low-rank representation for subspace clustering , 2013, Pattern Recognit..

[21]  Ching-Ta Lu,et al.  Denoising of salt-and-pepper noise corrupted image using modified directional-weighted-median filter , 2012, Pattern Recognit. Lett..

[22]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Narendra Ahuja,et al.  Video denoising by combining Kalman and Wiener estimates , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[24]  Michael Elad,et al.  Double Sparsity: Learning Sparse Dictionaries for Sparse Signal Approximation , 2010, IEEE Transactions on Signal Processing.

[25]  Hanling Zhang,et al.  Recovering low-rank and sparse components of matrices for object detection , 2013 .

[26]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[27]  Michael Elad,et al.  Image Sequence Denoising via Sparse and Redundant Representations , 2009, IEEE Transactions on Image Processing.

[28]  Patrick Bouthemy,et al.  Space-Time Adaptation for Patch-Based Image Sequence Restoration , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Yonina C. Eldar,et al.  Exploiting Statistical Dependencies in Sparse Representations for Signal Recovery , 2010, IEEE Transactions on Signal Processing.

[30]  Karen O. Egiazarian,et al.  Video denoising using separable 4D nonlocal spatiotemporal transforms , 2011, Electronic Imaging.

[31]  Aggelos K. Katsaggelos,et al.  Noise reduction filters for dynamic image sequences: a review , 1995, Proc. IEEE.

[32]  Lihe Zhang,et al.  Low-rank, sparse matrix decomposition and group sparse coding for image classification , 2012, 2012 19th IEEE International Conference on Image Processing.

[33]  Paul W. Fieguth,et al.  Wavelet Video Denoising with Regularized Multiresolution Motion Estimation , 2006, EURASIP J. Adv. Signal Process..