Demosaicking based on channel-correlation adaptive dictionary learning

Abstract. Image demosaicking is the problem of reconstructing color images from raw images captured using a digital camera with a color filter array. Sparse representation-based demosaicking method achieves superior performance on the commonly used Kodak dataset; however, it performs inferior on the IMAX dataset. We analyze that the factor of the sparse representation-based demosaicking methods that perform inconsistently is channel-correlation, which we define as the mean value of correlation coefficients between the RGB channels. Accordingly, we propose a channel-correlation adaptive dictionary learning-based demosaicking method. Different from the sparse representation-based demosaicking methods that use a fixed dictionary, our method trains a general dictionary on training image patches with various channel-correlations. Then, we learn a function matrix between the general dictionary and channel-correlations. For a raw image patch with an estimated channel-correlation, we compute a dictionary corresponding to its channel-correlation through the function matrix. Finally, we demosaick it with the corresponding dictionary using the sparse representation model. Experiments confirm that the proposed method performs adaptively well on raw images with various channel-correlations.

[1]  Jia Li,et al.  Optimized Color Filter Arrays for Sparse Representation-Based Demosaicking. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[2]  Yuk-Hee Chan,et al.  Low-complexity color demosaicing algorithm based on integrated gradients , 2010, J. Electronic Imaging.

[3]  Jian Yu,et al.  Automatic Design of High-Sensitivity Color Filter Arrays with Panchromatic Pixels. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[4]  Yücel Altunbasak,et al.  Gradient based threshold free color filter array interpolation , 2010, 2010 IEEE International Conference on Image Processing.

[5]  Lei Zhang,et al.  Color demosaicking by local directional interpolation and nonlocal adaptive thresholding , 2011, J. Electronic Imaging.

[6]  Wangmeng Zuo,et al.  COLOR IMAGE DEMOSAICKING VIA DEEP RESIDUAL LEARNING , 2017 .

[7]  Yap-Peng Tan,et al.  Hybrid color filter array demosaicking for effective artifact suppression , 2006, J. Electronic Imaging.

[8]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[9]  Gwanggil Jeon,et al.  Least-Squares Luma–Chroma Demultiplexing Algorithm for Bayer Demosaicking , 2011, IEEE Transactions on Image Processing.

[10]  Zhixun Su,et al.  Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning , 2013, Machine Learning.

[11]  Karen O. Egiazarian,et al.  Spatially adaptive color filter array interpolation for noiseless and noisy data , 2007, Int. J. Imaging Syst. Technol..

[12]  Frédo Durand,et al.  Deep joint demosaicking and denoising , 2016, ACM Trans. Graph..

[13]  Masatoshi Okutomi,et al.  Minimized-Laplacian residual interpolation for color image demosaicking , 2014, Electronic Imaging.

[14]  Masatoshi Okutomi,et al.  Adaptive residual interpolation for color image demosaicking , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Rama Chellappa,et al.  Domain Adaptive Dictionary Learning , 2012, ECCV.

[16]  Radu Timofte,et al.  Demosaicing Based on Directional Difference Regression and Efficient Regression Priors , 2016, IEEE Transactions on Image Processing.

[17]  Jian Yu,et al.  Automatic Design of Color Filter Arrays in the Frequency Domain , 2016, IEEE Transactions on Image Processing.

[18]  Yen-Wei Chen,et al.  Penrose Demosaicking , 2015, IEEE Transactions on Image Processing.

[19]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.

[20]  Linmi Tao,et al.  A Patch Aware Multiple Dictionary Framework for Demosaicing , 2014, ACCV.

[21]  Antoni Buades,et al.  Self-Similarity and Spectral Correlation Adaptive Algorithm for Color Demosaicking , 2014, IEEE Transactions on Image Processing.

[22]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[23]  Lei Zhang,et al.  Color demosaicking via directional linear minimum mean square-error estimation , 2005, IEEE Transactions on Image Processing.

[24]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Yücel Altunbasak,et al.  Multiscale Gradients-Based Color Filter Array Interpolation , 2013, IEEE Transactions on Image Processing.