Ambiguity-Free Radiometric Calibration for Internet Photo Collections

Radiometrically calibrating nonlinear images from Internet photo collections makes photometric analysis applicable not only to lab data but also to big image data in the wild. However, conventional calibration methods cannot be directly applied to such photo collections. This paper presents a method to jointly perform radiometric calibration for a set of nonlinear images in Internet photo collections. By incorporating the consistency of scene reflectance of corresponding pixels across nonlinear images, the proposed method first estimates radiometric response functions of all the nonlinear images up to a unique exponential ambiguity using a rank minimization framework. The ambiguity is then resolved using the linear edge color blending constraint. Quantitative evaluation using both synthetic and real-world data shows the effectiveness of the proposed method.

[1]  Katsushi Ikeuchi,et al.  Photometric Stereo Using Internet Images , 2014, 2014 2nd International Conference on 3D Vision.

[2]  Yasuyuki Matsushita,et al.  Radiometric calibration using temporal irradiance mixtures , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Takeo Kanade,et al.  Statistical Calibration of the CCD Imaging Process , 2001, ICCV.

[4]  M. Pollefeys,et al.  Radiometric Self-Alignment of Image Sequences ( CVPR ’ 04 ) , 2004 .

[5]  Shree K. Nayar,et al.  Determining the Camera Response from Images: What Is Knowable? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jan-Michael Frahm,et al.  Radiometric calibration with illumination change for outdoor scene analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Yasuyuki Matsushita,et al.  Self-calibrating photometric stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Ira Kemelmacher-Shlizerman,et al.  Exploring photobios , 2011, ACM Trans. Graph..

[9]  Ayan Chakrabarti,et al.  An Empirical Camera Model for Internet Color Vision , 2009, BMVC.

[10]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[11]  Yasuyuki Matsushita,et al.  Radiometric Calibration for Internet Photo Collections , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Katsushi Ikeuchi,et al.  Radiometric Calibration by Rank Minimization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Adrien Bousseau,et al.  Coherent intrinsic images from photo collections , 2012, ACM Trans. Graph..

[15]  J. F. Reid,et al.  RGB calibration for color image analysis in machine vision , 1996, IEEE Trans. Image Process..

[16]  Youngbae Hwang,et al.  Difference-Based Image Noise Modeling Using Skellam Distribution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Peter F. Sturm,et al.  Estimating Photometric Properties from Image Collections , 2013, Journal of Mathematical Imaging and Vision.

[18]  Michael S. Brown,et al.  Revisiting radiometric calibration for color computer vision , 2011, 2011 International Conference on Computer Vision.

[19]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2007, SIGGRAPH 2007.

[20]  Sai-Kit Yeung,et al.  Self-Calibrating Polarising Radiometric Calibration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Shih-Fu Chang,et al.  Using Geometry Invariants for Camera Response Function Estimation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[23]  Kun Zhou,et al.  Radiometric Calibration from Faces in Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Shree K. Nayar,et al.  Priors for Large Photo Collections and What They Reveal about Cameras , 2008, ECCV.

[25]  Yiying Tong,et al.  Adaptive 3D Face Reconstruction from Unconstrained Photo Collections , 2017, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Stephen Lin,et al.  Semantic colorization with internet images , 2011, ACM Trans. Graph..

[27]  Richard Szeliski,et al.  Finding paths through the world's photos , 2008, ACM Trans. Graph..

[28]  In-So Kweon,et al.  Efficient and Robust Color Consistency for Community Photo Collections , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Shree K. Nayar,et al.  Modeling the space of camera response functions , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Ping Tan,et al.  Photometric stereo and weather estimation using internet images , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Pradeep Sen,et al.  Robust Radiometric Calibration for Dynamic Scenes in the Wild , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[32]  Steven M. Seitz,et al.  The Visual Turing Test for Scene Reconstruction , 2013, 2013 International Conference on 3D Vision.

[33]  Dani Lischinski,et al.  Optimizing color consistency in photo collections , 2013, ACM Trans. Graph..

[34]  Wojciech Matusik,et al.  Image restoration using online photo collections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[35]  Stephen Lin,et al.  A New In-Camera Imaging Model for Color Computer Vision and Its Application , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Steven M. Seitz,et al.  Time-lapse mining from internet photos , 2015, ACM Trans. Graph..

[37]  Stephen Lin,et al.  Radiometric calibration from a single image , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[38]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..

[39]  Pedro Rodrigues,et al.  Single-image estimation of the camera response function in near-lighting , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Stephen Lin,et al.  Determining the radiometric response function from a single grayscale image , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Stephen Lin,et al.  Radiometric Calibration from Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Pieter Peers,et al.  Radiometric Transfer: Example‐based Radiometric Linearization of Photographs , 2015, Comput. Graph. Forum.

[44]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Peter F. Sturm,et al.  Radiometric calibration using photo collections , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[46]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..