Removing depth map coding distortion by using post filter set

We propose a fast post filter set for removing coding distortions of depth maps. Lossy coding generates various distortions, such as mosquito and block noises, edge blurs, and over quantization. These distortions seriously deteriorate image quality of synthesized views in free viewpoint image rendering. Thus, we propose the post filter set which includes median filter, Gaussian filter, min-max blur remove filer, and binary weighted range filter to remove these noises. In experiments, we use various codecs, which are JPEG, JPEG-LS, JPEG2000, and H.264/AVC, for depth map coding, and synthesize views with the coded depth maps. Experimental results show that our post filter set can improves every codecs performance. Improvement of PSNR is larger than the conventional post filter, and especially JPEG is large. The computational time of the filter set, which is implemented by C++ with SIMD optimization, is within 5.2 ms at high bit rate cases, and within 15.3 ms at low bit rate cases.

[1]  Antonio Ortega,et al.  Depth map coding with distortion estimation of rendered view , 2010, Electronic Imaging.

[2]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[3]  Aljoscha Smolic,et al.  Multi-View Video Plus Depth Representation and Coding , 2007, 2007 IEEE International Conference on Image Processing.

[4]  Daniel Lemire,et al.  Streaming Maximum-Minimum Filter Using No More than Three Comparisons per Element , 2006, Nord. J. Comput..

[5]  Hideaki Kimata,et al.  Block-adaptive palette-based prediction for depth map coding , 2011, 2011 18th IEEE International Conference on Image Processing.

[6]  Toshiaki Fujii,et al.  FTV for 3-D Spatial Communication , 2012, Proceedings of the IEEE.

[7]  Aljoscha Smolic,et al.  Coding Algorithms for 3DTV—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Patrick Hébert,et al.  Median Filtering in Constant Time , 2007, IEEE Transactions on Image Processing.

[9]  Yutaka Ishibashi,et al.  Weighted Joint Bilateral Filter with Slope Depth Compensation Filter for Depth Map Refinement , 2013, VISAPP.

[10]  Dong Tian,et al.  New Depth Coding Techniques With Utilization of Corresponding Video , 2011, IEEE Transactions on Broadcasting.

[11]  Yo-Sung Ho,et al.  Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Minh N. Do,et al.  Depth Video Enhancement Based on Weighted Mode Filtering , 2012, IEEE Transactions on Image Processing.

[13]  Toshiaki Fujii,et al.  A semi-automatic multi-view depth estimation method , 2010, Visual Communications and Image Processing.

[14]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Peter H. N. de With,et al.  Platelet-based coding of depth maps for the transmission of multiview images , 2006, Electronic Imaging.

[16]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[17]  Gauthier Lafruit,et al.  Cross-Based Local Stereo Matching Using Orthogonal Integral Images , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Toshiaki Fujii,et al.  View generation with 3D warping using depth information for FTV , 2009, Signal Process. Image Commun..

[20]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[21]  Lucas J. van Vliet,et al.  Separable bilateral filtering for fast video preprocessing , 2005, 2005 IEEE International Conference on Multimedia and Expo.