A new approach to outdoor illumination estimation based on statistical analysis for augmented reality

Illumination consistency plays an important role in realistic rendering of virtual characters which are integrated into a live video of real scene. This paper proposes a novel method for estimating the illumination conditions of outdoor videos captured by a fixed viewpoint. We first derive an analytical model which relates the statistics of an image to the lighting parameters of the scene adhering to the basic illumination model. Exploiting this model, we then develop a framework to estimate the lighting conditions of live videos. In order to apply the above approach to scenes containing dynamic objects such as intrusive pedestrians and swaying trees, we enforce two constraints, namely spatial and temporal illumination coherence, to refine the solution. Our approach requires no geometric information of the scenes and is sufficient for real-time performance. Experiments show that with the lighting parameters recovered by our method, virtual characters can be seamlessly integrated into the live video. Copyright © 2010 John Wiley & Sons, Ltd. This paper proposes a novel method for estimating in real time the lighting conditions of outdoor videos, captured under a fixed viewpoint. Experiments show that with the lighting parameters recovered by our method, virtual characters can be seamlessly integrated into a live video. The figure shows one frame of an augmented video in which a cowboy and a wine barrel are integrated into the scene.