Resolving occlusion in image sequence made easy

While the task of seamlessly merging computer-generated 3D objects into an image sequence can be done manually, such effort often lacks consistency across the images. It is also time consuming and prone to error. This paper proposes a framework that solves the occlusion problem without assuming a priori computer models from the input scene. It includes a new algorithm to derive approximate 3D models about the real scene based on recovered geometry information and usersupplied segmentation results. The framework has been implemented, and it works for amateur home videos. The result is an easy-to-use system for applications like the visualization of new architectures in a real environment.

[1]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[3]  Narendra Ahuja,et al.  Motion and structure estimation using long sequence motion models , 1993, Image Vis. Comput..

[4]  Hua Yu,et al.  3D shape and motion by SVD under higher-order approximation of perspective projection , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[5]  Reinhard Koch,et al.  Automatic Reconstruction of Buildings from Stereoscopic Image Sequences , 1993, Comput. Graph. Forum.

[6]  Tomoyuki Nishita,et al.  A montage method: the overlaying of the computer generated images onto a background photograph , 1986, SIGGRAPH.

[7]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[8]  Takeo Kanade,et al.  Affine structure from line correspondences with uncalibrated affine cameras , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Matthias M. Wloka,et al.  Resolving occlusion in augmented reality , 1995, I3D '95.

[10]  Takashi Totsuka,et al.  AutoKey: human assisted key extraction , 1995, SIGGRAPH.

[11]  Marie-Odile Berger.  Resolving occlusion in augmented reality: a contour based approach without 3D reconstruction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[13]  David E. Breen,et al.  Interactive Occlusion and Automatic Object Placement for Augmented Reality , 1996, Comput. Graph. Forum.

[14]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[15]  Olivier D. Faugeras,et al.  Feed-forward recovery of motion and structure from a sequence of 2D-lines matches , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[16]  Richard Szeliski,et al.  Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least Squares , 1994, J. Vis. Commun. Image Represent..

[17]  Gerhard Ertl,et al.  MOVE-X: A System for Combining Video Films and Computer Animation , 1991, Eurographics.

[18]  Naonori Ueda,et al.  A contour tracking method using an elastic contour model and an energy-minimization approach , 1993, Systems and Computers in Japan.