Joint disparity and variable size-block optimization algorithm for stereoscopic image compression

Abstract This paper addresses the disparity map estimation problem in the context of stereoscopic image coding. It is undeniable that the use of variable size blocks offers the possibility to describe more precisely the predicted view but at the expense of a high bitrate if no particular consideration is taken into account by the estimation algorithm. Indeed more information related to the block layout, considered here as a block-length map, is required at the prediction step. This paper presents an algorithm which jointly optimizes the block-length map as well as the disparity map so as to ensure a good reconstruction of the predicted view while minimizing the bitrate. This is done thanks to a joint metric taking into account the quality of the reconstruction as well as the bitrate needed to encode the maps. Moreover the developed algorithm iteratively improves its performance by refining the estimated maps. Simulation results conducted on several stereoscopic images from the CMU-VASC and the Middlebury dataset confirm the benefits of this approach as compared to competitive block matching algorithms.

[1]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[2]  Kemal Ugur,et al.  Motion Compensated Prediction and Interpolation Filter Design in H.265/HEVC , 2013, IEEE Journal of Selected Topics in Signal Processing.

[3]  Antonio Ortega,et al.  Stereo image compression with disparity compensation using the MRF model , 1996, Other Conferences.

[4]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[5]  Filippo Speranza,et al.  Stereoscopic 3D-TV: Visual Comfort , 2011, IEEE Transactions on Broadcasting.

[6]  S. Ra,et al.  An efficient disparity estimation algorithm for stereoscopic image compression , 1997 .

[7]  Minglun Gong,et al.  Genetic-Based Stereo Algorithm and Disparity Map Evaluation , 2002, International Journal of Computer Vision.

[8]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[9]  Heiko Hirschmüller,et al.  Evaluation of Cost Functions for Stereo Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Cedric Nishan Canagarajah,et al.  Efficient multiview image compression using quadtree disparity estimation , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[11]  Monson H. Hayes,et al.  Stereo image coding: a projection approach , 1998, IEEE Trans. Image Process..

[12]  Patrick Le Callet,et al.  Stereoscopic images quality assessment , 2007, 2007 15th European Signal Processing Conference.

[13]  Udo Zölzer,et al.  FFT-based disparity estimation for stereo image coding , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Mei Yu,et al.  Approaches to H.264-based stereoscopic video coding , 2004, Third International Conference on Image and Graphics (ICIG'04).

[16]  Anthony G. Constantinides,et al.  Variable size block matching motion compensation with applications to video coding , 1990 .

[17]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[18]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[19]  Wijnand A. IJsselsteijn,et al.  Perceived quality of compressed stereoscopic images: Effects of symmetric and asymmetric JPEG coding and camera separation , 2006, TAP.

[20]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[21]  Oliver Schreer,et al.  An immersive 3D video-conferencing system using shared virtual team user environments , 2002, CVE '02.

[22]  Amel Benazza-Benyahia,et al.  Vector Lifting Schemes for Stereo Image Coding , 2009, IEEE Transactions on Image Processing.

[23]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Gabriel Dauphin,et al.  Sequential block-based disparity map estimation algorithm for stereoscopic image coding , 2015, Signal Process. Image Commun..

[25]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[26]  Aysha Kadaikar,et al.  Modified block matching algorithm improving rate-distortion performance for stereoscopic image coding , 2015, 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).