Statistical Calibration of the CCD Imaging Process

Charge-Coupled Device (CCD) canieras are widely used imaging sensors in coniputer vision systems. Many photometric algorithms, such as shape from shading, color constancy, and photometric stereo, iniplicitly assume that the image intensily is proportional to scene radiance. The actual image measurements deviate significantly from this assuniption since the transforniation from scene radiance to image intensity is non-linear and is a function of various factors including: noise sources in the CCD sensor, as well as various transformations occurring in the canieru including: white balancing, gamma correction and automatic gain control. This paper illustrates how careful modelling of the error sources and the various processing steps enable us to accurately estimate the “response fiinction ”, the inverse mapping from iniage measurements to scene rudiunce for a given camera exposure setting. It is shown that the estimation algorithm outpe@ornis the calibration procedures known to us in ternis of reduced bias and variance. Further, we demonstrate how the error modelling helps us to obtuin uncertainty estiniuies of the camera irradiance value. The power of this uncertainty modeling is illustruted hy a vision task involving High Dynaniic Range image generution followed by change detection. Change can be detected reliably even in situation where the two images (the reference scene image and the current image) are taken several hours apart.

[1]  J. Kalbfleisch Statistical Inference Under Order Restrictions , 1975 .

[2]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[3]  L. Maloney Evaluation of linear models of surface spectral reflectance with small numbers of parameters. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[4]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[5]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[6]  Steven A. Shafer,et al.  Obtaining accurate color images for machine-vision research , 1990, Electronic Imaging.

[7]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[8]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Masashi Baba,et al.  Photometric calibration of zoom lens systems , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  Dahong Qian,et al.  An automatic light spectrum compensation method for CCD white balance measurement , 1997 .

[11]  Glenn Healey,et al.  The Illumination-Invariant Matching of Deterministic Local Structure in Color Images , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jr. James E. Adams,et al.  Design of practical color filter array interpolation algorithms for digital cameras , 1997, Electronic Imaging.

[13]  Takeo Kanade,et al.  Temporal photoreception for adaptive dynamic range image sensing and encoding , 1998, Neural Networks.

[14]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).