Aerial Image Relighting: Simulating Time of Day Variations

We present a technique for simulating variations in appearance of aerial images at different sun angles. The input to the algorithm is a single aerial image with information on the orientation of surfaces in the image. The location, date, and time at which the photograph was taken are also needed by the algorithm. The appearance of the aerial image at a new sun angle is synthesized by compensating for the direct sunlight component in the original image, and then relighting the image with sunlight from the new sun position. Techniques to remove cast shadows are also described. We demonstrate our results with images, and animations of changing lighting in aerial photographs as the sun follows a trajectory across the sky.

[1]  Masashi Baba,et al.  Shadow removal from a real picture , 2003, SIGGRAPH '03.

[2]  Steve Marschner,et al.  Inverse Lighting for Photography , 1997, CIC.

[3]  Céline Loscos,et al.  Automatic generation of consistent shadows for augmented reality , 2005, Graphics Interface.

[4]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[5]  Sébastien Roy,et al.  Automatic relighting of overlapping textures of a 3D model , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Jitendra Malik,et al.  Recovering photometric properties of architectural scenes from photographs , 1998, SIGGRAPH.

[7]  Peter Shirley,et al.  A practical analytic model for daylight , 1999, SIGGRAPH.

[8]  A. Venetsanopoulos,et al.  A color segmentation scheme for object-based video coding , 1998, 1998 IEEE Symposium on Advances in Digital Filtering and Signal Processing. Symposium Proceedings (Cat. No.98EX185).

[9]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Peter K. Allen,et al.  Relighting acquired models of outdoor scenes , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[11]  ClausB. MadsenandRuneLaursen,et al.  Image Relighting : Getting the Sun to Set in an Image Taken at Noon , 2004 .

[12]  Rita Cucchiara,et al.  Improving shadow suppression in moving object detection with HSV color information , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[13]  M. Iqbal An introduction to solar radiation , 1983 .

[14]  S. Marschner,et al.  Inverse Rendering for Computer Graphics , 1998 .

[15]  Yoshiki Nakamura,et al.  International commission on illumination , 1928, Journal of the A.I.E.E..