Illumination Recovery from Images with Cast Shadows Illumination Recovery from Images with Cast Shadows

Title of thesis: ILLUMINATION RECOVERY FROM IMAGES WITH CAST SHADOWS Xue Mei Master of Science, 2007 Thesis directed by: Professor Gang Qu Department of Electrical and Computer Engineering and Professor David Jacobs Department of Computer Science The effects produced in an image by cast shadows can be quite complex, especially when light comes from all directions. This makes it difficult to recover the illumination from a scene and recognize objects from the images. In this paper, we show that such images can be well approximated using much simpler lighting represented by a combination of low frequency spherical harmonics, and a small number of directional sources. Therefore, the illumination of the scene can be recovered by summing the spherical harmonic lighting and a small number of directional light sources. To demonstrate the effectiveness of the proposed method, we have successfully tested it by using sets of synthesized images rendered by directional light sources or environment maps with different objects. ILLUMINATION RECOVERY FROM IMAGES WITH CAST SHADOWS

[1]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[3]  Peter W. Hallinan.  A low-dimensional representation of human faces for arbitrary lighting conditions , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Julie Dorsey,et al.  Effic ient Re-rendering of Naturally Illuminated Environments , 1994 .

[5]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[7]  Yee-Hong Yang,et al.  Illuminant direction determination for multiple light sources , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  K. Ikeuchi,et al.  Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Yongduek Seo,et al.  Improving AR using shadows arising from natural illumination distribution in video sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Ravi Ramamoorthi,et al.  Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Katsushi Ikeuchi,et al.  Determining reflectance and light position from a single image without distant illumination assumption , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Amnon Shashua,et al.  On Photometric Issues in 3D Visual Recognition from a Single 2D Image , 2004, International Journal of Computer Vision.

[16]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Ravi Ramamoorthi,et al.  A Fourier theory for cast shadows , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  David W. Jacobs,et al.  Non-negative lighting and specular object recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.