Plane-based methods for 3D reconstruction and video enhancement

Despite research activity during the past decade, the problem of how to carry out 3D scene reconstruction from a video sequence is not fully solved. Many techniques exist, useful in different situations. However, for a general scene, methods can still be quite costly in terms of time. The present paper discusses methods whereby the existence of planar or almost planar sections of the scene may be exploited throughout the reconstruction process. We consider the homography induced by a plane to aid in point tracking, projective reconstruction, self calibration and model building. Two recent algorithms for projective reconstruction in the presence of planes are reexamined and presented in a new form.