Scalable coding and progressive transmission of concentric mosaic using nonlinear filter banks

This paper studies the scalable coding and progressive transmission of concentric mosaic to support interactive applications over a LAN or the Internet. Concentric mosaic is an effective 3D image based representation of a static scene. A typical concentric mosaic might consist of thousands of images, which poses significant problem in digital storage and transmission. A new multiresolution decomposition for supporting progressive transmission of a concentric mosaic is proposed. Instead of using the popular 9/7 wavelet filterbank, a nonlinear perfect reconstruction filter bank with lower arithmetic complexity is employed. It also considerably simplifies the random access operation of the slit images during rendering. By encoding the subband signals into different layers, a scalable compressed bit stream of the concentric mosaic is obtained. Therefore, progressive transmission of concentric mosaic, using a combination of these layers, to support devices with different capabilities become possible.

[1]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[2]  Harry Shum,et al.  Virtual reality using the concentric mosaic: construction, rendering and data compression , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[3]  S. C. Chan,et al.  An adaptive multiresolution modification of the H.263 video coding algorithm , 1997, Proceedings of ICICS, 1997 International Conference on Information, Communications and Signal Processing. Theme: Trends in Information Systems Engineering and Wireless Multimedia Communications (Cat..

[4]  S. C. Chan,et al.  A multiresolution two-layer video codec for networking applications , 1996, Proceedings of Third International Conference on Signal Processing (ICSP'96).

[5]  Yunnan Wu,et al.  Compression of concentric mosaic scenery with alignment and 3D wavelet transform , 2000, Electronic Imaging.

[6]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[7]  A NON-LINEAR FILTER BANK FOR IMAGE CODING - Circuits and Systems, 1995., Proceedings., Proceedings of the 38th Midwest Symposium on , 2004 .

[8]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[9]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[10]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Tsuhan Chen,et al.  Compression with mosaic prediction for image-based rendering applications , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[12]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[13]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[14]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[15]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and texture-mapped models , 1997, International Conference on Computer Graphics and Interactive Techniques.

[16]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..