IRW: an incremental representation for image-based walkthroughs

We present a new representation for image-based interactive walk-throughs. The target applications reconstruct a scene from novel viewpoints using samples from a spatial image dataset collected from a plane at eye-level. These datasets consist of pose augmented 2D images and often have a very large number of samples. Our representation exploits spatial coherence and rearranges the input samples as epipolar images. The base unit corresponds to a column of the original image that can be individually addressed and accessed. The overall representation, IRW, supports incremental updates, efficient encoding, scalable performance, and selective inclusion used by different reconstruction algorithms. We demonstrate the performance of our representation on a synthetic as well as a real-world environment.

[1]  François X. Sillion,et al.  Multi‐layered impostors for accelerated rendering , 1999, Comput. Graph. Forum.

[2]  Camillo J. Taylor.  Video Plus , 2000 .

[3]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and texture-mapped models , 1997, International Conference on Computer Graphics and Interactive Techniques.

[4]  Paul Lalonde,et al.  Interactive Rendering of Wavelet Projected Light Fields , 1999, Graphics Interface.

[5]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[6]  Nelson L. Max,et al.  Rendering Trees from Precomputed Z-Buffer Views , 1995, Rendering Techniques.

[7]  Amitabh Varshney,et al.  Walkthroughs of complex environments using image-based simplification , 1998 .

[8]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[9]  Daniel G. Aliaga,et al.  MMR: an interactive massive model rendering system using geometric and image-based acceleration , 1999, SI3D.

[10]  Yunnan Wu,et al.  Smart rebinning for compression of concentric mosaics , 2000, ACM Multimedia.

[11]  Dinesh Manocha,et al.  A video-based rendering acceleration algorithm for interactive walkthroughs , 2000, ACM Multimedia.

[12]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[13]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[14]  Anselmo Lastra,et al.  Automatic image placement to provide a guaranteed frame rate , 1999, SIGGRAPH.

[15]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[16]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[17]  Gavin S. P. Miller,et al.  Lazy Decompression of Surface Light Fields for Precomputed Global Illumination , 1998, Rendering Techniques.

[18]  Marc Levoy.  Polygon-assisted JPEG and MPEG compression of synthetic images , 1995, SIGGRAPH.

[19]  Dinesh Manocha,et al.  Spatially-encoded far-field representations for interactive walkthroughs , 2001, MULTIMEDIA '01.

[20]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[21]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[22]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[23]  Katsushi Ikeuchi,et al.  Arbitrary view position and direction rendering for large-scale scenes , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[24]  George Drettakis,et al.  Efficient Impostor Manipulation for Real‐Time Visualization of Urban Scenery , 1997, Comput. Graph. Forum.

[25]  Peter Shirley,et al.  Visual navigation of large environments using textured clusters , 1995, I3D '95.

[26]  Dinesh Manocha,et al.  Spatially encoded image-space simplifications for interactive walkthrough , 2002 .

[27]  Marcus A. Magnor,et al.  Model-based coding of multiviewpoint imagery , 2000, Visual Communications and Image Processing.

[28]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[29]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[30]  William J. Dally,et al.  Point Sample Rendering , 1998, Rendering Techniques.

[31]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .

[32]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Daniel G. Aliaga,et al.  Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs , 2001, SIGGRAPH.

[34]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[35]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.