Spatially adaptive color filter array interpolation for noiseless and noisy data

Conventional single‐chip digital cameras use color filter arrays (CFA) to sample different spectral components. Demosaicing algorithms interpolate these data to complete red, green, and blue values for each image pixel, to produce an RGB image. In this article, we propose a novel demosaicing algorithm for the Bayer CFA. For the algorithm design, we assume that, following the concept proposed in (Zhang and Wu, IEEE Trans Image Process 14 ( 2005 ), 2167–2178), the initial interpolation estimates of color channels contain two additive components: the true values of color intensities and the errors that are considered as an additive noise. A specially designed signal‐adaptive filter is used to remove this so‐called demosaicing noise. This filter is based on the local polynomial approximation (LPA) and the paradigm of the intersection of confidence intervals applied to select varying scales of LPA. This technique is nonlinear and spatially‐adaptive with respect to the smoothness and irregularities of the image. The presented CFA interpolation (CFAI) technique takes significant advantage from assuming that the original data is noise‐free. Nevertheless, in many applications, the observed data is noisy, where the noise is treated as an important intrinsic degradation of the data. We develop an adaptation of the proposed CFAI for noisy data, integrating the denoising and CFAI into a single procedure. It is assumed that the data is given according to the Bayer pattern and corrupted by signal‐dependant noise common for charge‐coupled device and complementary‐symmetry/metal‐oxide semiconductor sensors. The efficiency of the proposed approach is demonstrated by experimental results with simulated and real data. © 2007 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 17, 105–122, 2007

[1]  Soo-Chang Pei,et al.  Effective color interpolation in CCD color filter arrays using signal correlation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Daniel Keren,et al.  Restoring subsampled color images , 1999, Machine Vision and Applications.

[3]  Ken Parulski,et al.  Color image processing for digital cameras , 2002 .

[4]  Ron Kimmel,et al.  Demosaicing: Image Reconstruction from Color CCD Samples , 1998, ECCV.

[5]  R.W. Schafer,et al.  Demosaicking: color filter array interpolation , 2005, IEEE Signal Processing Magazine.

[6]  Dimitrios Hatzinakos,et al.  A novel cost effective demosaicing approach , 2004, IEEE Transactions on Consumer Electronics.

[7]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Giancarlo Calvagno,et al.  Demosaicing With Directional Filtering and a posteriori Decision , 2007, IEEE Transactions on Image Processing.

[9]  Ossi Kalevo,et al.  Noise reduction techniques for Bayer-matrix images , 2002, IS&T/SPIE Electronic Imaging.

[10]  K. Egiazarian,et al.  Noise Measurement for Raw-Data of Digital Imaging Sensors by Automatic Segmentation of Nonuniform Targets , 2007, IEEE Sensors Journal.

[11]  Vladimir Katkovnik,et al.  Demosaicing of noisy data: spatially adaptive approach , 2007, Electronic Imaging.

[12]  Rastislav Lukac,et al.  Data adaptive filters for demosaicking: a framework , 2005, IEEE Transactions on Consumer Electronics.

[13]  Radu Ciprian Bilcu,et al.  Color filter array interpolation based on spatial adaptivity , 2007, Electronic Imaging.

[14]  K. Martin,et al.  Vector filtering for color imaging , 2005, IEEE Signal Processing Magazine.

[15]  Aggelos K. Katsaggelos,et al.  Bayesian Reconstruction of Color Images Acquired with a Single CCD , 2005, IbPRIA.

[16]  H.J. Trussell,et al.  Color image processing [basics and special issue overview] , 2005, IEEE Signal Processing Magazine.

[17]  David S. Taubman Generalized Wiener reconstruction of images from colour sensor data using a scale invariant prior , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[18]  Thomas W. Parks,et al.  Adaptive homogeneity-directed demosaicing algorithm , 2005, IEEE Transactions on Image Processing.

[19]  Rastislav Lukac,et al.  Single-Sensor Camera Image Processing , 2006 .

[20]  Rastislav Lukac,et al.  Normalized color-ratio modeling for CFA interpolation , 2004, IEEE Transactions on Consumer Electronics.

[21]  Karen O. Egiazarian,et al.  Anisotropic local approximations for pointwise adaptive signal-dependent noise removal , 2005, 2005 13th European Signal Processing Conference.

[22]  Ning Zhang,et al.  Primary-consistent soft-decision color demosaicking for digital cameras (patent pending) , 2004, IEEE Transactions on Image Processing.

[23]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[24]  Wesley E. Snyder,et al.  Adaptive demosaicking , 2003, J. Electronic Imaging.

[25]  Rastislav Lukac,et al.  Color filter arrays: design and performance analysis , 2005, IEEE Transactions on Consumer Electronics.

[26]  R. Lukac,et al.  An efficient CFA interpolation solution , 2004, Proceedings. Elmar-2004. 46th International Symposium on Electronics in Marine.

[27]  Jaakko Astola,et al.  Local Approximation Techniques in Signal and Image Processing (SPIE Press Monograph Vol. PM157) , 2006 .

[28]  Kevin E. Spaulding,et al.  Color processing in digital cameras , 1998, IEEE Micro.

[29]  Eric Dubois,et al.  Frequency-domain methods for demosaicking of Bayer-sampled color images , 2005, IEEE Signal Processing Letters.

[30]  Jaakko Astola,et al.  Adaptive Window Size Image De-noising Based on Intersection of Confidence Intervals (ICI) Rule , 2002, Journal of Mathematical Imaging and Vision.

[31]  Rastislav Lukac,et al.  Demosaicked image postprocessing using local color ratios , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Rastislav Lukac,et al.  Demosaicking using Vector Spectral Model , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[33]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.

[34]  Thomas W. Parks,et al.  Joint demosaicing and denoising , 2006, IEEE Trans. Image Process..

[35]  Xin Li,et al.  Demosaicing by successive approximation , 2005, IEEE Transactions on Image Processing.

[36]  Brian A. Wandell,et al.  Color image quality metric S-CIELAB and its application on halftone texture visibility , 1997, Proceedings IEEE COMPCON 97. Digest of Papers.

[37]  Vladimir Katkovnik,et al.  A new method for varying adaptive bandwidth selection , 1999, IEEE Trans. Signal Process..

[38]  Sabine Süsstrunk,et al.  Color Demosaicing by Estimating Luminance and Opponent Chromatic Signals in the Fourier Domain , 2002, CIC.

[39]  Stan Z. Li,et al.  Learning multiview face subspaces and facial pose estimation using independent component analysis , 2005, IEEE Transactions on Image Processing.

[40]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[41]  Lei Zhang,et al.  Color demosaicking via directional linear minimum mean square-error estimation , 2005, IEEE Transactions on Image Processing.