Calibration of Real Scenes for the Reconstruction of Dynamic Light Fields

SUMMARY The classic light field and lumigraph are two well–known approaches to image–based rendering, and subsequently many new rendering techniques and representations have been proposed based on them. Nevertheless the main limitation remains that in almost all ofthem only static scenes are considered. In this contribution we describe a method for calibrating a scene which includes moving or deforming objects from multiple image sequences taken with a hand–held camera. For each image sequence the scene is assumed to be static, which allows the reconstruction ofa conventional static light field. The dynamic light field is thus composed ofmultiple static light fields, each of which describes the state ofthe scene at a certain point in time. This allows not only the modeling ofrigid moving objects, but any kind ofmotion including def ormations. In order to facilitate the automatic calibration, some assumptions are made for the scene and input data, such as that the image sequences for each respective time step share one common camera pose and that only the minor part ofthe scene is actually in motion.