Radiometric Calibration for Internet Photo Collections

Radiometrically calibrating the images from Internet photo collections brings photometric analysis from lab data to big image data in the wild, but conventional calibration methods cannot be directly applied to such image data. This paper presents a method to jointly perform radiometric calibration for a set of images in an Internet photo collection. By incorporating the consistency of scene reflectance for corresponding pixels in multiple images, the proposed method estimates radiometric response functions of all the images using a rank minimization framework. Our calibration aligns all response functions in an image set up to the same exponential ambiguity in a robust manner. Quantitative results using both synthetic and real data show the effectiveness of the proposed method.

[1]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[2]  Pradeep Sen,et al.  Robust Radiometric Calibration for Dynamic Scenes in the Wild , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[3]  Shree K. Nayar,et al.  Modeling the space of camera response functions , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2008, Commun. ACM.

[5]  Ira Kemelmacher-Shlizerman,et al.  Exploring photobios , 2011, SIGGRAPH 2011.

[6]  Stephen Lin,et al.  Determining the radiometric response function from a single grayscale image , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Stephen Lin,et al.  Radiometric Calibration from Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Katsushi Ikeuchi,et al.  Photometric Stereo Using Internet Images , 2014, 2014 2nd International Conference on 3D Vision.

[10]  Yasuyuki Matsushita,et al.  Radiometric calibration using temporal irradiance mixtures , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Ling Shao,et al.  Multimedia Interaction and Intelligent User Interfaces , 2010 .

[12]  Pieter Peers,et al.  Radiometric Transfer: Example‐based Radiometric Linearization of Photographs , 2015, Comput. Graph. Forum.

[13]  M. Pollefeys,et al.  Radiometric Self-Alignment of Image Sequences ( CVPR ’ 04 ) , 2004 .

[14]  Jan-Michael Frahm,et al.  Radiometric calibration with illumination change for outdoor scene analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Peter F. Sturm,et al.  Estimating Photometric Properties from Image Collections , 2013, Journal of Mathematical Imaging and Vision.

[16]  Yasuyuki Matsushita,et al.  Self-calibrating photometric stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Katsushi Ikeuchi,et al.  Radiometric Calibration by Rank Minimization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Youngbae Hwang,et al.  Difference-Based Image Noise Modeling Using Skellam Distribution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Shree K. Nayar,et al.  Priors for Large Photo Collections and What They Reveal about Cameras , 2008, ECCV.

[20]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[21]  Wojciech Matusik,et al.  Image restoration using online photo collections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Steven M. Seitz,et al.  Time-lapse mining from internet photos , 2015, ACM Trans. Graph..

[23]  Takeo Kanade,et al.  Statistical calibration of CCD imaging process , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Stephen Lin,et al.  Semantic colorization with internet images , 2011, ACM Trans. Graph..

[25]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Peter F. Sturm,et al.  Radiometric calibration using photo collections , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[27]  Shih-Fu Chang,et al.  Using Geometry Invariants for Camera Response Function Estimation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[29]  Heung-Yeung Shum,et al.  Radiometric calibration from a single image , 2004, CVPR 2004.

[30]  Ping Tan,et al.  Photometric stereo and weather estimation using internet images , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Steven M. Seitz,et al.  Finding paths through the world's photos , 2008, SIGGRAPH 2008.

[32]  In-So Kweon,et al.  Efficient and Robust Color Consistency for Community Photo Collections , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Adrien Bousseau,et al.  Coherent intrinsic images from photo collections , 2012, ACM Trans. Graph..

[34]  J. F. Reid,et al.  RGB calibration for color image analysis in machine vision , 1996, IEEE Trans. Image Process..

[35]  Shi-Min Hu,et al.  Sketch2Photo: internet image montage , 2009, ACM Trans. Graph..