Noise modelling in time-of-flight sensors with application to depth noise removal and uncertainty estimation in three-dimensional measurement

Time-of-flight (TOF) sensors provide real-time depth information at high frame-rates. One issue with TOF sensors is the usual high level of noise (i.e. the depth measure's repeatability within a static setting). However, until now, TOF sensors’ noise has not been well studied. The authors show that the commonly agreed hypothesis that noise depends only on the amplitude information is not valid in practice. They empirically establish that the noise follows a signal-dependent Gaussian distribution and varies according to pixel position, depth and integration time. They thus consider all these factors to model noise in two new noise models. Both models are evaluated, compared and used in the two following applications: depth noise removal by depth filtering and uncertainty (repeatability) estimation in three-dimensional measurement.

[1]  H. Lilliefors On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[2]  John M. Chambers,et al.  Graphical Methods for Data Analysis , 1983 .

[3]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Peter Seitz,et al.  The lock-in CCD-two-dimensional synchronous detection of light , 1995 .

[5]  Jongeun Cha,et al.  Depth Video Enhancement for Haptic Interaction Using a Smooth Surface Reconstruction , 2006, IEICE Trans. Inf. Syst..

[6]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[7]  Andreas Kolb,et al.  Lateral and Depth Calibration of PMD-Distance Sensors , 2006, ISVC.

[8]  Andreas Kolb,et al.  Calibration of the intensity-related distance error of the PMD TOF-camera , 2007, SPIE Optics East.

[9]  Seung-man Kim,et al.  Depth Image Processing Technique for Representing Human Actors in 3DTV using Single Depth Camera , 2007, 2007 3DTV Conference.

[10]  R. Koch,et al.  CALIBRATION OF A PMD-CAMERA USING A PLANAR CALIBRATION PATTERN TOGETHER WITH A MULTI-CAMERA SETUP , 2008 .

[11]  Ruigang Yang,et al.  Fusion of time-of-flight depth and stereo for high accuracy depth maps , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Boris Jutzi,et al.  Investigations on ambiguity unwrapping of range images , 2009 .

[13]  Robert Mahony,et al.  Statistical analysis of measurement processes for time-of-flight cameras , 2009, Optical Engineering + Applications.

[14]  Mongi A. Abidi,et al.  Spatial and Temporal Enhancement of Depth Images Captured by a Time-of-Flight Depth Sensor , 2010, 2010 20th International Conference on Pattern Recognition.

[15]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[16]  A. Mertins,et al.  Time-of-flight depth image denoising using prior noise information , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[17]  Kamel Hamrouni,et al.  Depth Correction for Depth Camera From Planarity , 2012, BMVC.

[18]  Kamel Hamrouni,et al.  Non-parametric depth calibration of a TOF camera , 2012, 2012 19th IEEE International Conference on Image Processing.