Weighted Sum-Based Color Filter Array Interpolation Using Taylor Series Cubic Approximation

In this paper, we introduce a weighted sum-based color filter array interpolation method using Taylor series cubic approximation. We use a high-order approximation to predict accurate pixel values during the reconstruction of quincunx grid-sampled green channels, and perform a weighted average-based interpolation in a large local window. We also perform prediction utilizing a color difference model in a small local window to generate additional green values. By applying the weighted sum method to the predicted green values in two local windows, green channel can be enhanced. The remaining color components, namely, the rectangular grid-sampled red and blue channels, are interpolated utilizing the weighted average method of the color difference model. Additionally, we propose a post-processing method that removes the zipper artifacts generated during the interpolation process. Experimental results demonstrate that the proposed color filter array interpolation system outperforms existing algorithms in terms of both objective and subjective performance.

[1]  Kai-Lung Hua,et al.  DeepDemosaicking: Adaptive Image Demosaicking via Multiple Deep Fully Convolutional Networks , 2018, IEEE Transactions on Image Processing.

[2]  Zhou Dengwen,et al.  Colour demosaicking with directional filtering and weighting , 2012 .

[3]  Lei Zhang,et al.  Color demosaicking by local directional interpolation and nonlocal adaptive thresholding , 2011, J. Electronic Imaging.

[4]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[5]  Kai-Lung Hua,et al.  Context-aware joint dictionary learning for color image demosaicking , 2016, J. Vis. Commun. Image Represent..

[6]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[7]  Yuk-Hee Chan,et al.  Color Demosaicing Using Variance of Color Differences , 2006, IEEE Transactions on Image Processing.

[8]  Pei-Yu Chang,et al.  Effective demosaicking algorithm based on edge property for color filter arrays , 2012, Digit. Signal Process..

[9]  Jin Wang,et al.  Taylor series and adaptive directional selection for real time demosaicking , 2016, Displays.

[10]  Yücel Altunbasak,et al.  Edge Strength Filter Based Color Filter Array Interpolation , 2012, IEEE Transactions on Image Processing.

[11]  Yap-Peng Tan,et al.  Color filter array demosaicking: new method and performance measures , 2003, IEEE Trans. Image Process..

[12]  Wen-Chung Kao,et al.  Effective demosaicing using subband correlation , 2009, 2009 Digest of Technical Papers International Conference on Consumer Electronics.

[13]  Kai-Lung Hua,et al.  Self-learning approach to color demosaicking via support vector regression , 2012, 2012 19th IEEE International Conference on Image Processing.

[14]  Giancarlo Calvagno,et al.  Color image demosaicking: An overview , 2011, Signal Process. Image Commun..

[15]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[16]  Lei Zhang,et al.  Image demosaicing: a systematic survey , 2008, Electronic Imaging.

[17]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[18]  Soo-Chang Pei,et al.  Effective color interpolation in CCD color filter arrays using signal correlation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[19]  Gwanggil Jeon,et al.  Color filter array interpolation by successive refinement over color channels using gradient inverse-weighted filtering , 2014 .

[20]  Ron Kimmel,et al.  Demosaicing: Image Reconstruction from Color CCD Samples , 1998, ECCV.

[21]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.