Analyzing Modern Camera Response Functions

Camera Response Functions (CRFs) map the irradiance incident at a sensor pixel to an intensity value in the corresponding image pixel. The nonlinearity of CRFs impact physics-based and low-level computer vision methods like de-blurring, photometric stereo, etc. In addition, CRFs have been used for forensics to identify regions of an image spliced in from a different camera. Despite its importance, the process of radiometrically calibrating a camera's CRF is significantly harder and less standardized than geometric calibration. Competing methods use different mathematical models of the CRF, some of which are derived from an outdated dataset. We present a new dataset of 178 CRFs from modern digital cameras, derived from 1565 camera review images available online, and use it to answer a series of questions about CRFs. Which mathematical models are best for CRF estimation? How have they changed over time? And how unique are CRFs from camera to camera?

[1]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[2]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[3]  Rongrong Wang,et al.  Detecting doctored images using camera response normality and consistency , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Hany Farid,et al.  Blind inverse gamma correction , 2001, IEEE Trans. Image Process..

[5]  Takeo Kanade,et al.  Statistical Calibration of the CCD Imaging Process , 2001, ICCV.

[6]  Shih-Fu Chang,et al.  Using Geometry Invariants for Camera Response Function Estimation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  Shree K. Nayar,et al.  Modeling the space of camera response functions , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Michael S. Brown,et al.  Nonlinear Camera Response Functions and Image Deblurring: Theoretical Analysis and Practice , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Steve Mann,et al.  Comparametric equations with practical applications in quantigraphic image processing , 2000, IEEE Trans. Image Process..

[11]  Katsushi Ikeuchi,et al.  Estimating Radiometric Response Functions from Image Noise Variance , 2008, ECCV.

[12]  Shih-Fu Chang,et al.  Image Splicing Detection using Camera Response Function Consistency and Automatic Segmentation , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[13]  Tian-Tsong Ng,et al.  Camera response function signature for digital forensics - Part II: Signature extraction , 2009, 2009 First IEEE International Workshop on Information Forensics and Security (WIFS).

[14]  J. F. Reid,et al.  RGB calibration for color image analysis in machine vision , 1996, IEEE Trans. Image Process..

[15]  Shih-Fu Chang,et al.  Camera Response Functions for Image Forensics: An Automatic Algorithm for Splicing Detection , 2010, IEEE Transactions on Information Forensics and Security.

[16]  D. Pascale.  RGB coordinates of the Macbeth ColorChecker , 2006 .

[17]  Shree K. Nayar,et al.  Determining the Camera Response from Images: What Is Knowable? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Stephen Lin,et al.  Radiometric Calibration from Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Feng Li,et al.  A Theoretical Analysis of Camera Response Functions in Image Deblurring , 2012, ECCV.

[20]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).