Color filter array demosaicking: new method and performance measures

Single-sensor digital cameras capture imagery by covering the sensor surface with a color filter array (CFA) such that each sensor pixel only samples one of three primary color values. To render a full-color image, an interpolation process, commonly referred to as CFA demosaicking, is required to estimate the other two missing color values at each pixel. In this paper, we present two contributions to the CFA demosaicking: a new and improved CFA demosaicking method for producing high quality color images and new image measures for quantifying the performance of demosaicking methods. The proposed demosaicking method consists of two successive steps: an interpolation step that estimates missing color values by exploiting spatial and spectral correlations among neighboring pixels, and a post-processing step that suppresses noticeable demosaicking artifacts by adaptive median filtering. Moreover, in recognition of the limitations of current image measures, we propose two types of image measures to quantify the performance of different demosaicking methods; the first type evaluates the fidelity of demosaicked images by computing the peak signal-to-noise ratio and CIELAB DeltaE(*)(ab) for edge and smooth regions separately, and the second type accounts for one major demosaicking artifact-zipper effect. We gauge the proposed demosaicking method and image measures using several existing methods as benchmarks, and demonstrate their efficacy using a variety of test images.

[1]  L. V. Eycken,et al.  Evaluation of Uniform Color Spaces Developed after the Adoption of CIELAB and CIELUV , 1994, Color Research & Application.

[2]  Maya R. Gupta,et al.  Vector color filter array demosaicing , 2001, IS&T/SPIE Electronic Imaging.

[3]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Edward Y. Chang,et al.  Color filter array recovery using a threshold-based variable number of gradients , 1999, Electronic Imaging.

[5]  Peter B. Delahunt,et al.  Perceptual assessment of demosaicing algorithm performance , 2002, Proc. IEEE.

[6]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[7]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[8]  Soo-Chang Pei,et al.  Effective color interpolation in CCD color filter array using signal correlation , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[9]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  John A. Weldy Optimized Design For A Single-Sensor Color Electronic Camera System , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[11]  Kevin E. Spaulding,et al.  Color processing in digital cameras , 1998, IEEE Micro.

[12]  Mahdi Nezamabadi,et al.  Color Appearance Models , 2014, J. Electronic Imaging.

[13]  Michael H. Brill,et al.  Color appearance models , 1998 .

[14]  Jr. James E. Adams,et al.  Design of practical color filter array interpolation algorithms for digital cameras , 1997, Electronic Imaging.

[15]  G. Eichmann,et al.  Vector median filters , 1987 .

[16]  Ron Kimmel,et al.  Demosaicing: Image Reconstruction from Color CCD Samples , 1998, ECCV.

[17]  Soo-Chang Pei,et al.  Effective color interpolation in CCD color filter arrays using signal correlation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[18]  Jr. James E. Adams,et al.  Interactions between color plane interpolation and other image processing functions in electronic photography , 1995, Electronic Imaging.

[19]  Wesley E. Snyder,et al.  Demosaicking methods for Bayer color arrays , 2002, J. Electronic Imaging.