A modified joint trilateral filter based depth map refinement method

We present a modified joint trilateral filter based method for depth map refinement. Seeded region growing algorithm and Euclidean distance transform(EDT) are involved for error pixels extraction. With the error information wiped out, a joint trilateral filter method is employed as a hole filling strategy to fill the values. Compared to the basic bilateral filter method, structural similarity index(SSIM) is added as the third lateral, while a threshold and an aberration condition are involved for modification to protect the edges and improve the confidence of the filling values. Both qualitative analysis and quantitative analysis are shown to testify the performance. Comparisons between our method and the other popular methods are provided.

[1]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[3]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Mongi A. Abidi,et al.  Spatial and Temporal Enhancement of Depth Images Captured by a Time-of-Flight Depth Sensor , 2010, 2010 20th International Conference on Pattern Recognition.

[6]  Kwan H. Lee,et al.  An iterative joint bilateral filtering for depth refinement of a 3D model , 2011, SA '11.

[7]  Maziar Loghman,et al.  Refinement of depth maps generated by low-cost depth sensors , 2012, 2012 International SoC Design Conference (ISOCC).

[8]  Shawmin Lei,et al.  A depth map refinement algorithm for 2D-to-3D conversion , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Kai-Lung Hua,et al.  Joint trilateral filtering for depth map super-resolution , 2013, 2013 Visual Communications and Image Processing (VCIP).

[10]  Seung-Won Jung,et al.  Enhancement of Image and Depth Map Using Adaptive Joint Trilateral Filter , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Chongyu Chen,et al.  A color-guided, region-adaptive and depth-selective unified framework for Kinect depth recovery , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[12]  Voronin Viacheslav,et al.  Kinect depth map restoration using modified exemplar-based inpainting , 2014, 2014 12th International Conference on Signal Processing (ICSP).