Camera and light calibration from reflections on a sphere

This paper introduces a novel method for recovering light directions and camera parameters using a single sphere. Traditional methods for estimating light directions using spheres either assume both the radius and center of the sphere being known precisely, or they depend on multiple calibrated views to recover these parameters. In this paper, it will be shown that light directions can be uniquely determined from specular highlights observed in a single view of a sphere without knowing or recovering the exact radius and center of the sphere. Besides, given multiple views of the sphere, it will be shown that the focal length and the relative positions and orientations of the cameras can be determined using the recovered sphere and light directions. Closed form solutions for estimation of light directions and camera poses are presented, and an optimization procedure for estimation of the focal length is introduced. Experimental results on synthetic and real data demonstrates both the accuracy and robustness of the proposed method.

[1]  Yang Wang,et al.  Estimation of multiple directional illuminants from a single image , 2008, Image Vis. Comput..

[2]  Dmitry B. Goldgof,et al.  Calibration of light sources , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Kwan-Yee Kenneth Wong,et al.  Recovering Light Directions and Camera Poses from a Single Sphere , 2008, ECCV.

[4]  Yuichi Taguchi,et al.  Analytical Forward Projection for Axial Non-central Dioptric and Catadioptric Cameras , 2010, ECCV.

[5]  Alan L. Yuille,et al.  Sources from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  A. Pentland.  Finding the illuminant direction , 1982 .

[7]  Vincent Lepetit,et al.  3D pose refinement from reflections , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Gregory Dudek,et al.  Out of the Dark: Using Shadows to Reconstruct 3D Surfaces , 1998, ACCV.

[9]  Euijin Kim,et al.  Fast and Robust Ellipse Extraction from Complicated Images , 2002 .

[10]  Michael J. Brooks,et al.  Shape and Source from Shading , 1985, IJCAI.

[11]  Roberto Cipolla,et al.  Reconstruction in the Round Using Photometric Normals and Silhouettes. , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[13]  Naoki Saito,et al.  A Method to Detect and Characterize Ellipses Using the Hough Transform , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Stephen Lin,et al.  Multiple-cue illumination estimation in textured scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[16]  Rama Chellappa,et al.  Estimation of illuminant direction, albedo, and shape from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  David G. Stork,et al.  Computer Analysis of Lighting in Realist Master Art: Current Methods and Future Challenges , 2009, ICIAP.

[18]  Kosuke Sato,et al.  Determining Reflectance Properties of an Object Using Range and Brightness Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[20]  Zhenwen Dai,et al.  Polygonal Light Source Estimation , 2009, ACCV.

[21]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[22]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Amit K. Agrawal,et al.  Single Image Calibration of Multi-axial Imaging Systems , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Chia-Hoang Lee,et al.  Using highlights to constrain object size and location , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  David W. Jacobs,et al.  Using specularities for recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[26]  Ramesh Raskar,et al.  3D pose estimation and segmentation using specular cues , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Yee-Hong Yang,et al.  Multiple Illuminant Direction Detection with Application to Image Synthesis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Xiaochun Cao,et al.  Camera calibration and light source estimation from images with shadows , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Qiang Ji,et al.  A new efficient ellipse detection method , 2002, Object recognition supported by user interaction for service robots.

[30]  Kwan-Yee Kenneth Wong,et al.  Reconstruction of display and eyes from a single image , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Andrew Blake,et al.  Geometry From Specularities , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[32]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[34]  Pascal Fua,et al.  Retrieving multiple light sources in the presence of specular reflections and texture , 2008, Comput. Vis. Image Underst..

[35]  Wei Zhou,et al.  Estimation of Illuminant Direction and Intensity of Multiple Light Sources , 2002, ECCV.

[36]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.