Boundary-Preserving Depth Upsampling Without Texture Copying Artifacts and Holes

In this paper, we propose boundary-preserving depth upsampling without texture copying artifacts and holes. Since high-resolution (HR) color images contain many edges and textures, they inevitably cause artifacts such as texture copying when they are used in depth upsampling. Thus, we perform rolling guidance filtering on HR color images before depth upsampling to preserve object boundaries in depth maps while successfully removing texture copying artifacts. Moreover, upsampled depth maps are often corrupted by noise and contain holes along object boundaries. Thus, we utilize fast weighted median filtering after depth upsampling to remove noise and fill holes. Experimental results demonstrate that the proposed method achieves boundary-preserving depth upsampling results without texture copying artifacts and holes through visual and quantitative evaluations.

[1]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[2]  Demin Wang,et al.  Stereoscopic image generation based on depth images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[3]  Patrick Pérez,et al.  Geodesic image and video editing , 2010, TOGS.

[4]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[5]  T. Lindeberg,et al.  Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[6]  Sebastian Thrun,et al.  A Noise‐aware Filter for Real‐time Depth Upsampling , 2008 .

[7]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[8]  T. Oggier,et al.  4 . 1 3 D-Imaging in Real-Time with Miniaturized Optical Range Camera , 2005 .

[9]  Donghoon Yeo,et al.  Adaptive bilateral filtering for noise removal in depth upsampling , 2010, 2010 International SoC Design Conference.

[10]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Qi Zhang,et al.  100+ Times Faster Weighted Median Filter (WMF) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Enhua Wu,et al.  Constant Time Weighted Median Filtering for Stereo Matching and Beyond , 2013, 2013 IEEE International Conference on Computer Vision.