A weighted least squares algorithm for time-of-flight depth image denoising

Abstract In this paper, we present a new denoising method for the depth image of a time-of-flight (ToF) camera, based on weighted least squares (WLS) framework. The common method for ToF depth image denoising is to use bilateral filter. However, the ability of bilateral filter in edge preservation would be reduced while we attempt to smooth out larger spatial scale noise. In order to avoid this problem and preserve the edge information as much as possible, we introduce a new way to construct edge-preserving ToF depth image denoising based on WLS. We are to our knowledge the first to present a WLS-based method for ToF depth image denoising. Experimental results demonstrate that compared with bilateral filter, our proposed algorithm not only achieves better performance in edge preservation, but also improves the PSNR values of the denoised images by 0.5–2.6 dB.

[1]  Reginald L. Lagendijk,et al.  Regularized iterative image restoration with ringing reduction , 1988, IEEE Trans. Acoust. Speech Signal Process..

[2]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[3]  Sebastian Thrun,et al.  High-quality scanning using time-of-flight depth superresolution , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[4]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[5]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[6]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, SIGGRAPH 2006.

[7]  Wilfried Philips,et al.  Fuzzy logic-based approach to wavelet denoising of 3D images produced by time-of-flight cameras. , 2010, Optics express.

[8]  A. Mertins,et al.  Time-of-flight depth image denoising using prior noise information , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[9]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[10]  Fred A. Hamprecht,et al.  Denoising of continuous-wave time-of-flight depth images using confidence measures , 2009, Optical Engineering.

[11]  Timo Schairer,et al.  Robust non-local denoising of colored depth data , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Lena Maier-Hein,et al.  Adaptive bilateral filter for image denoising and its application to in-vitro Time-of-Flight data , 2011, Medical Imaging.

[13]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .