Discovering Point Lights with Intensity Distance Fields

We introduce the light localization problem. A scene is illuminated by a set of unobserved isotropic point lights. Given the geometry, materials, and illuminated, appearance of the scene, the light localization problem is to completely recover the number, positions, and intensities of the lights. We first present a scene transform that identifies likely light positions. Based on this transform, we develop an iterative algorithm to locate remaining lights and determine all light intensities. We demonstrate the success of this method in a large set of 2D synthetic scenes, and show that it extends to 3D, in both synthetic scenes and real-world scenes.

[1]  Yang Wang,et al.  Estimation of multiple directional light sources for synthesis of augmented reality images , 2002, Graph. Model..

[2]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[3]  Pascal Fua,et al.  Using Specularities to Recover Multiple Light Sources in the Presence of Texture , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Matthias Nießner,et al.  Shading-based refinement on volumetric signed distance functions , 2015, ACM Trans. Graph..

[5]  Yee-Hong Yang,et al.  Multiple Illuminant Direction Detection with Application to Image Synthesis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Hiroshi Kawasaki,et al.  Simultaneous Camera, Light Position and Radiant Intensity Distribution Calibration , 2015, PSIVT.

[7]  Zhenwen Dai,et al.  Polygonal Light Source Estimation , 2009, ACCV.

[8]  Éric Marchand,et al.  Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[9]  Simon Fuhrmann,et al.  Geometric Point Light Source Calibration , 2013, VMV.

[10]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[11]  Michael Goesele,et al.  Shading-Aware Multi-view Stereo , 2016, ECCV.

[12]  Alan L. Yuille,et al.  Sources from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Nikos Paragios,et al.  Illumination estimation and cast shadow detection through a higher-order graphical model , 2011, CVPR 2011.

[14]  Katsushi Ikeuchi,et al.  Light source position and reflectance estimation from a single view without the distant illumination assumption , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Erik Reinhard,et al.  Multiple Light Source Estimation in a Single Image , 2013, Comput. Graph. Forum.

[16]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Michael F. Cohen,et al.  Emptying, refurnishing, and relighting indoor spaces , 2016, ACM Trans. Graph..

[18]  Dmitry B. Goldgof,et al.  A Simple Strategy for Calibrating the Geometry of Light Sources , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Yang Wang,et al.  Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry , 2002, ECCV.

[20]  Paolo Favaro,et al.  Uncalibrated Near-Light Photometric Stereo , 2014, BMVC.

[21]  Atsuto Maki,et al.  Difference Sphere: An Approach to Near Light Source Estimation , 2004, CVPR.

[22]  Robert B. Fisher,et al.  Point Light Source Estimation based on Scenes Recorded by a RGB-D camera , 2013, BMVC.

[23]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[24]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[25]  Yasuyuki Matsushita,et al.  Calibrating a Non-isotropic Near Point Light Source Using a Plane , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Gregory H. Bearman,et al.  Near light correction for image relighting and 3D shape recovery , 2015, 2015 Digital Heritage.

[27]  Taeone Kim,et al.  A practical approach for estimating illumination distribution from shadows using a single image , 2005, Int. J. Imaging Syst. Technol..

[28]  Oliver Grau,et al.  Discrete Light Source Estimation from Light Probes for Photorealistic Rendering , 2015, BMVC.

[29]  Wei Zhou,et al.  Estimation of the size and location of multiple area light sources , 2004, ICPR 2004.

[30]  Atsuto Maki,et al.  Self shadows and cast shadows in estimating illumination distribution , 2007 .

[31]  Koch,et al.  Markerless Augmented Reality with Light Source Estimation for Direct Illumination , 2006 .

[32]  Stephen Lin,et al.  Multiple-cue illumination estimation in textured scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.