Motion Consistency for Image-Based Rendering

This paper presents an enhancement to current image-based rendering methods. It suggests that motion consistency can be used in a realtime dynamic rendering system to increase computational efficiency up to one order of magnitude. Parameterization of the image warping function with respect to the viewer’s motion can be used to provide an efficient method for extrapolating new viewpoints using a single rendered image. The system is successfully tested in the context of a flight simulator using a first order parameterization.

[1]  Thomas S. Huang,et al.  SOLVING THREE DIMENSIONAL SMALL-ROTATION MOTION EQUATIONS. , 1983, CVPR 1983.

[2]  Dan S. Wallach,et al.  Accelerated MPEG compression of dynamic polygonal scenes , 1994, SIGGRAPH.

[3]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[4]  Russell M. Mersereau,et al.  Motion compensated compression of computer animation frames , 1993, SIGGRAPH.

[5]  Jan-Olof Eklundh,et al.  Object detection using model based prediction and motion parallax , 1990, ECCV.

[6]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Voicu Popescu,et al.  The WarpEngine: an architecture for the post-polygonal age , 2000, SIGGRAPH.

[8]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[9]  John Snyder,et al.  Rendering with coherent layers , 1997, SIGGRAPH.

[10]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[11]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[12]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[13]  Steven M. Seitz,et al.  Physically-valid view synthesis by image interpolation , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[14]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[15]  Maneesh Agrawala,et al.  Model-based motion estimation for synthetic animations , 1995, MULTIMEDIA '95.

[16]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[17]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.