A mesh-based disparity representation method for view interpolation and stereo image compression

This paper proposes a mesh-based representation method for the disparity map of stereo images. The proposed method is designed to concentrate mainly on applications of view interpolation and stereo image compression. To obtain high image quality in the view interpolation and compression of stereo images, we formulate the view-interpolation error and prediction error. In the formulation, the view-interpolation and prediction errors depend not only on the accuracy of the disparity map, but also on the gradient of the stereo images. The proposed representation method for the disparity map is based on a triangular mesh structure, which minimizes the formulated interpolation and prediction errors. The experimental results show that the proposed method yields higher quality view-interpolated images and also has better performance in stereo image compression than the conventional methods.

[1]  Hai Tao,et al.  Compression and transmission of depth maps for image-based rendering , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Michael Garland,et al.  Fast Triangular Approximation of Terrains and Height Fields , 2008 .

[3]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[4]  Leonidas J. Guibas,et al.  Primitives for the manipulation of general subdivisions and the computation of Voronoi diagrams , 1983, STOC.

[5]  Siegmund Pastoor,et al.  3D-television: A survey of recent research results on subjective requirements , 1991, Signal Process. Image Commun..

[6]  M. Lukacs,et al.  Predictive coding of multi-viewpoint image sets , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Hyun Wook Park,et al.  Fast view interpolation of stereo images using image gradient and disparity triangulation , 2003, Signal Process. Image Commun..

[8]  King Ngi Ngan,et al.  Disparity map coding based on adaptive triangular surface modelling , 1998, Signal Process. Image Commun..

[9]  Nikolaos Grammalidis,et al.  Sprite generation and coding of multiview image sequences , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[10]  Jeffrey S. McVeigh,et al.  Algorithm for automated eye-strain reduction in real stereoscopic images and sequences , 1996, Electronic Imaging.

[11]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[12]  Yao Wang,et al.  Multiview video sequence analysis, compression, and virtual viewpoint synthesis , 2000, IEEE Trans. Circuits Syst. Video Technol..

[13]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[14]  STEREOSCOPIC IMAGE SEQUENCE COMPRESSION USING MULTIRESOLUTION AND QUADTREE DECOMPOSITION BASED DISPARITY- AND MOTION-ADAPTIVE SEGMENTATION , 1996 .

[15]  Leonidas J. Guibas,et al.  Primitives for the manipulation of general subdivisions and the computation of Voronoi diagrams , 1983, STOC.

[16]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).