Edge-preserving disparity estimation and disparity-compensated intermediate view reconstruction for stereo images

A constrained disparity estimation method is proposed which uses a directional regularization technique to efficiently preserve edges for stereo image coding. The proposed method smoothes disparity vectors in smooth regions and preserves edges in object boundaries well, without creating an oversmoothing problem. The differential pulse code modulation (DPCM) technique for disparity map coding is used prior to entropy coding, in order to improve the overall coding efficiency. The proposed disparity estimation method can also be applied to intermediate view reconstruction. Intermediate views between a left image and a right image provide reality and natural motion parallax to multiviewers. Intermediate views are synthesized by appropriately exploiting an interpolation or an extrapolation technique according to the characteristics of each region after identifying the regions as occluded regions, normal regions, and regions having ambiguous disparities.The experimental results show that the proposed disparity estimation method gives close matches between a left image and a right image and improves coding efficiency. In addition, we can subjectively confirm that the application of our proposed intermediate view reconstruction method leads to satisfactory intermediate views from a stereo image pair.

[1]  Alan N. Willson,et al.  Rate-distortion optimal motion estimation algorithms for motion-compensated transform video coding , 1998, IEEE Trans. Circuits Syst. Video Technol..

[2]  Jeffrey S. McVeigh,et al.  Intermediate view synthesis considering occluded and ambiguously referenced image regions , 1996, Signal Process. Image Commun..

[3]  Michael G. Strintzis,et al.  Motion and disparity field estimation using rate-distortion optimization , 1998, IEEE Trans. Circuits Syst. Video Technol..

[4]  Barry G. Haskell,et al.  Basics of stereoscopic video, new compression results with MPEG-2 and a proposal for MPEG-4 , 1997, Signal Process. Image Commun..

[5]  Sakae Okubo,et al.  MPEG-2 requirements, profiles and performance verification - Framework for developing a generic video coding standard , 1995, Signal Process. Image Commun..

[6]  Jin Liu,et al.  A three camera approach for calculating disparity and synthesizing intermediate pictures , 1991, Signal Process. Image Commun..

[7]  Nikolaos Grammalidis,et al.  Disparity and occlusion estimation in multiocular systems and their coding for the communication of multiview image sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..

[8]  Michael G. Strintzis,et al.  Evaluation of multiresolution block matching techniques for motion and disparity estimation , 1994, Signal Process. Image Commun..

[9]  M.Ebroul Izquierdo Stereo image analysis for multi-viewpoint telepresence applications , 1998 .

[10]  King Ngi Ngan,et al.  Disparity map coding based on adaptive triangular surface modelling , 1998, Signal Process. Image Commun..

[11]  Michael G. Perkins,et al.  Data compression of stereopairs , 1992, IEEE Trans. Commun..

[12]  Avideh Zakhor,et al.  Video compression using matching pursuits , 1999, IEEE Trans. Circuits Syst. Video Technol..