Image synthesis from a sparse set of views

The authors present an image synthesis methodology and a system built around it. Given a sparse set of photographs taken from unknown viewpoints, the system generates images from new, different viewpoints with correct perspective, and handles occlusion. It achieves this without requiring any knowledge about the 3D structure of the scene nor the intrinsic camera parameters. The photo-realistic rendering process is polygon based and can be potentially implemented as real time texture mapping. The system is robust to noise by taking advantage of duplicate information from multiple views. They present results on several example scenes.

[1]  Ramesh C. Jain,et al.  Reality modeling and visualization from multiple video sequences , 1996, IEEE Computer Graphics and Applications.

[2]  Ramakant Nevatia,et al.  Recovering LSHGCs and SHGCs from stereo , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[4]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[5]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[6]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[7]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[8]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[9]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[10]  Mi-Suen Lee,et al.  Synthesizing Novel Views from Unregistered 2‐D Images , 1997, Comput. Graph. Forum.

[11]  Amnon Shashua,et al.  Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition , 1993, 1993 (4th) International Conference on Computer Vision.

[12]  Zhengyou Zhang,et al.  A New Multistage Approach to Motion and Structure Estimation: From Essential Parameters to Euclidean , 1996 .

[13]  S. Ta'asan,et al.  A spline-based parameter estimation technique for static models of elastic structures , 1989 .

[14]  Leila De Floriani,et al.  An on-line algorithm for constrained Delaunay triangulation , 1992, CVGIP Graph. Model. Image Process..

[15]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[16]  Mi-Suen Lee,et al.  View Synthesis from Unregistered 2-D Images , 1996, Graphics Interface.

[17]  O. Faugeras,et al.  3-D Reconstruction of Urban Scenes from Sequences of Images , 1995 .

[18]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.