Self-Similarity Driven Color Demosaicking

Demosaicking is the process by which from a matrix of colored pixels measuring only one color component per pixel, red, green, or blue, one can infer a whole color information at each pixel. This inference requires a deep understanding of the interaction between colors, and the involvement of image local geometry. Although quite successful in making such inferences with very small relative error, state-of-the-art demosaicking methods fail when the local geometry cannot be inferred from the neighboring pixels. In such a case, which occurs when thin structures or fine periodic patterns were present in the original, state-of-the-art methods can create disturbing artifacts, known as zipper effect, blur, and color spots. The aim of this paper is to show that these artifacts can be avoided by involving the image self-similarity to infer missing colors. Detailed experiments show that a satisfactory solution can be found, even for the most critical cases. Extensive comparisons with state-of-the-art algorithms will be performed on two different classic image databases.

[1]  Thomas W. Parks,et al.  Adaptive homogeneity-directed demosaicing algorithm , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[2]  Lei Zhang,et al.  Improvement of Color Video Demosaicking in Temporal Domain , 2006, IEEE Transactions on Image Processing.

[3]  Thomas W. Parks,et al.  Joint demosaicing and denoising , 2006, IEEE Transactions on Image Processing.

[4]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[5]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[6]  Karen O. Egiazarian,et al.  Spatially adaptive color filter array interpolation for noiseless and noisy data , 2007, Int. J. Imaging Syst. Technol..

[7]  Michael Elad,et al.  Multiframe demosaicing and super-resolution of color images , 2006, IEEE Transactions on Image Processing.

[8]  Jong-Sen Lee,et al.  Digital image smoothing and the sigma filter , 1983, Comput. Vis. Graph. Image Process..

[9]  Peter B. Delahunt,et al.  Perceptual assessment of demosaicing algorithm performance , 2002, Proc. IEEE.

[10]  Yap-Peng Tan,et al.  Color filter array demosaicking: new method and performance measures , 2003, IEEE Trans. Image Process..

[11]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[12]  L. Shires Image , 2018, Victorian Literature and Culture.

[13]  R.W. Schafer,et al.  Demosaicking: color filter array interpolation , 2005, IEEE Signal Processing Magazine.

[14]  V. Katkovnik,et al.  Spatially adaptive color filter array interpolation for noiseless and noisy data: Articles , 2007 .

[15]  Yap-Peng Tan,et al.  Adaptive Filtering for Color Filter Array Demosaicking , 2007, IEEE Transactions on Image Processing.

[16]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.

[17]  Yuk-Hee Chan,et al.  Color Demosaicing Using Variance of Color Differences , 2006, IEEE Transactions on Image Processing.

[18]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[19]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Giancarlo Calvagno,et al.  Demosaicing With Directional Filtering and a posteriori Decision , 2007, IEEE Transactions on Image Processing.

[21]  Lei Zhang,et al.  Temporal color video demosaicking via motion estimation and data fusion , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  David Alleysson 30 ans de démosaïçage , 2004 .

[23]  David Zhang,et al.  Color Reproduction From Noisy CFA Data of Single Sensor Digital Cameras , 2007, IEEE Transactions on Image Processing.

[24]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Lei Zhang,et al.  Image demosaicing: a systematic survey , 2008, Electronic Imaging.

[26]  Lei Zhang,et al.  Color demosaicking via directional linear minimum mean square-error estimation , 2005, IEEE Transactions on Image Processing.

[27]  Wesley E. Snyder,et al.  Adaptive demosaicking , 2003, J. Electronic Imaging.

[28]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[29]  Jaakko Astola,et al.  Adaptive Window Size Image De-noising Based on Intersection of Confidence Intervals (ICI) Rule , 2002, Journal of Mathematical Imaging and Vision.

[30]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[32]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[33]  Thomas W. Parks,et al.  Joint demosaicing and denoising , 2006, IEEE Trans. Image Process..

[34]  Xin Li,et al.  Demosaicing by successive approximation , 2005, IEEE Transactions on Image Processing.