Light Source Detection in Photographs

Common tasks related to image processing or augmented reality include rendering new objects into existing images, or matching objects with unknown illumination. To facilitate such algorithms, it is often necessary to infer from which directions a scene was illuminated, even if only a photograph is available. For this purpose, we present a novel light source detection algorithm that, contrary to the current state-of-the-art, is able to detect multiple light sources with sufficient accuracy. 3D measures are not required, only the input image and a very small amount of unskilled user interaction.

[1]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[2]  Maneesh Agrawala,et al.  Soft scissors: an interactive tool for realtime high quality matting , 2007, ACM Trans. Graph..

[3]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Yee-Hong Yang,et al.  Default shape theory: with application to the computation of the direction of the light source , 1994 .

[5]  Toby Howard,et al.  Flexible Image‐Based Photometric Reconstruction using Virtual Light Sources , 2001, Comput. Graph. Forum.

[6]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[7]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[8]  Steve Marschner,et al.  Inverse Lighting for Photography , 1997, CIC.

[9]  Alan L. Yuille,et al.  Sources from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Katsushi Ikeuchi,et al.  Illumination Distribution from Brightness in Shadows: Adaptive Estimation of Illumination Distribution with Unknown Reflectance Properties in Shadow Regions , 1999, ICCV.

[11]  Pascal Fua,et al.  Using Specularities to Recover Multiple Light Sources in the Presence of Texture , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[12]  A. Pentland.  Finding the illuminant direction , 1982 .

[13]  Wei Zhou,et al.  Estimation of Illuminant Direction and Intensity of Multiple Light Sources , 2002, ECCV.

[14]  Alexei A. Efros,et al.  Photo clip art , 2007, SIGGRAPH 2007.

[15]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[16]  Jan-Olof Eklundh,et al.  Automatic estimation of the projected light source direction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Erik Reinhard,et al.  Image-based material editing , 2005, SIGGRAPH '05.

[18]  Michael J. Brooks,et al.  Shape and Source from Shading , 1985, IJCAI.

[19]  J. Koenderink,et al.  Light Direction from Shad(ow)ed Random Gaussian Surfaces , 2004, Perception.

[20]  Yee-Hong Yang,et al.  Multiple Illuminant Direction Detection with Application to Image Synthesis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[22]  Shree K. Nayar,et al.  Eyes for relighting , 2004, SIGGRAPH 2004.

[23]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[24]  Dmitry B. Goldgof,et al.  A Simple Strategy for Calibrating the Geometry of Light Sources , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Yang Wang,et al.  Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry , 2002, ECCV.

[26]  Andrew Zisserman,et al.  Estimating illumination direction from textured images , 2004, CVPR 2004.

[27]  Shree K. Nayar,et al.  Eyes for relighting , 2004, ACM Trans. Graph..

[28]  J. Koenderink,et al.  Irradiation direction from texture. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[29]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[30]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[31]  Andrew Zisserman,et al.  Estimating illumination direction from textured images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[32]  H H Bülthoff,et al.  A Prior for Global Convexity in Local Shape-from-Shading , 2001, Perception.

[33]  Narendra Ahuja,et al.  Estimation of the light source distribution and its use in integrated shape recovery from stereo and shading , 1993, 1993 (4th) International Conference on Computer Vision.

[34]  Michael Cohen,et al.  Soft scissors: an interactive tool for realtime high quality matting , 2007, SIGGRAPH 2007.

[35]  Patrick Cavanagh,et al.  Perceiving Illumination Inconsistencies in Scenes , 2005, Perception.