Perceptual assessment of demosaicing algorithm performance

Demosaicing is an important part of the image-processing chain for many digital color cameras. The demosaicing operation converts a raw image acquired with a single sensor array, overlaid with a color filter array, into a full-color image. In this paper, we report the results of two perceptual experiments that compare the perceptual quality of the output of different demosaicing algorithms. In the first experiment, we found that a Bayesian demosaicing algorithm produced the most preferred images. Detailed examination of the data, however indicated that the good performance of this algorithm was at least in part due to the fact that it sharpened the images while it demosaiced them. In a second experiment, we silenced image sharpness as a factor by applying a sharpening algorithm to the output of each demosaicing algorithm. The optimal amount of sharpening to be applied to each image was chosen using the results of a preliminary experiment. Once sharpness was equated in this way, an algorithm developed by Freeman based on bilinear interpolation combined with median filtering, gave the best results. An analysis of our data suggests that our perceptual results cannot be easily predicted using an image metric.

[1]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  David H. Brainard,et al.  Reconstructing Images from Trichromatic Samples: From Basic Research to Practical Applications , 1995, CIC.

[3]  V Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: experiments. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  V. Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: model. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[6]  Brian A. Wandell,et al.  Color image fidelity metrics evaluated using image distortion maps , 1998, Signal Process..

[7]  Ingeborg Tastl,et al.  Demosaicing using Human Visual Properties and Wavelet Interpolation Filtering , 1999, Color Imaging Conference.

[8]  Ron Kimmel,et al.  Demosaicing: Image Reconstruction from Color CCD Samples , 1998, ECCV.

[9]  Mark D. Fairchild,et al.  Sharpness Rules , 2000, Color Imaging Conference.

[10]  Lindsay W. MacDonald,et al.  Colour Difference Metrics and Image Sharpness , 2000, Color Imaging Conference.

[11]  Jerome D. Tietz,et al.  Image capture: simulation of sensor responses from hyperspectral images , 2001, IEEE Trans. Image Process..

[12]  David H. Brainard,et al.  Simulation of Digital Camera Images from Hyperspectral Input , 2001 .

[13]  David H. Brainard,et al.  An Ideal Observer for Appearance: Reconstruction from Samples , 2001 .