Linear demosaicing inspired by the human visual system

There is an analogy between single-chip color cameras and the human visual system in that these two systems acquire only one limited wavelength sensitivity band per spatial location. We have exploited this analogy, defining a model that characterizes a one-color per spatial position image as a coding into luminance and chrominance of the corresponding three colors per spatial position image. Luminance is defined with full spatial resolution while chrominance contains subsampled opponent colors. Moreover, luminance and chrominance follow a particular arrangement in the Fourier domain, allowing for demosaicing by spatial frequency filtering. This model shows that visual artifacts after demosaicing are due to aliasing between luminance and chrominance and could be solved using a preprocessing filter. This approach also gives new insights for the representation of single-color per spatial location images and enables formal and controllable procedures to design demosaicing algorithms that perform well compared to concurrent approaches, as demonstrated by experiments.

[1]  Ronald W. Schafer,et al.  A method of color filter array interpolation with alias cancellation properties , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Tetsuya Kuno,et al.  NEW INTERPOLATION METHOD USING DISCRIMINATED COLOR CORRELATION FOR DIGITAL STILL CAMERAS , 1999 .

[3]  David S. Taubman.  Generalized Wiener reconstruction of images from colour sensor data using a scale invariant prior , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[4]  Ron Kimmel,et al.  Demosaicing: Image Reconstruction from Color CCD Samples , 1998, ECCV.

[5]  Ingeborg Tastl,et al.  Demosaicing using Human Visual Properties and Wavelet Interpolation Filtering , 1999, Color Imaging Conference.

[6]  Jr. James E. Adams,et al.  Design of practical color filter array interpolation algorithms for digital cameras , 1997, Electronic Imaging.

[7]  Soo-Chang Pei,et al.  Effective color interpolation in CCD color filter array using signal correlation , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[8]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  J. Yellott.  Spectral analysis of spatial sampling by photoreceptors: Topological disorder prevents aliasing , 1982, Vision Research.

[10]  Yap-Peng Tan,et al.  Layering-based color filter array interpolation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[11]  Brian W. Keelan,et al.  Modulation Transfer Functions and Aliasing Patterns of CFA Interpolation Algorithms , 1998, PICS.

[12]  Tetsuya Kuno,et al.  Digital still cameras , 1999, IEEE Trans. Consumer Electron..

[13]  John A. Weldy.  Optimized Design For A Single-Sensor Color Electronic Camera System , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[14]  James E. Adams,et al.  Design of practical color filter array interpolation algorithms for digital cameras .2 , 1997, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[15]  Maya R. Gupta,et al.  Vector color filter array demosaicing , 2001, IS&T/SPIE Electronic Imaging.

[16]  Daniel Keren,et al.  Restoring subsampled color images , 1999, Machine Vision and Applications.

[17]  K. Mullen.  The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[18]  Kwanghoon Sohn,et al.  Performance comparison of various interpolation methods for color filter arrays , 2001, ISIE 2001. 2001 IEEE International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570).

[19]  Wesley E. Snyder,et al.  Adaptive demosaicking , 2003, J. Electronic Imaging.

[20]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  Thomas W. Parks,et al.  Demosaicing using optimal recovery , 2005, IEEE Transactions on Image Processing.

[22]  Sabine Süsstrunk,et al.  Color Demosaicing by Estimating Luminance and Opponent Chromatic Signals in the Fourier Domain , 2002, CIC.

[23]  Edward Y. Chang,et al.  Color filter array recovery using a threshold-based variable number of gradients , 1999, Electronic Imaging.

[24]  J. Greivenkamp.  Color dependent optical prefilter for the suppression of aliasing artifacts. , 1990, Applied optics.

[25]  Jr. James E. Adams,et al.  Interactions between color plane interpolation and other image processing functions in electronic photography , 1995, Electronic Imaging.

[26]  David H. Brainard,et al.  The Cost of Trichromacy for Spatial Vision , 1991 .

[27]  Philip Ogunbona,et al.  Method of color interpolation in a single sensor color camera using green channel separation , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[28]  H. Joel Trussell,et al.  Mathematics for demosaicking , 2002, IEEE Trans. Image Process..

[29]  Kwanghoon Sohn,et al.  Interpolation using neural networks for digital still cameras , 2000, IEEE Trans. Consumer Electron..

[30]  David Alleysson,et al.  Interpolation d'images couleurs sous échantillonnées par un modèle de perception , 2001 .

[31]  David H. Brainard,et al.  Reconstructing Images from Trichromatic Samples: From Basic Research to Practical Applications , 1995, CIC.