A Comparative Error Analysis of Current Time-of-Flight Sensors

Time-of-flight (ToF) cameras suffer from systematic errors, which can be an issue in many application scenarios. In this paper, we investigate the error characteristics of eight different ToF cameras. Our survey covers both well established and recent cameras including the Microsoft Kinect V2. We present up to six experiments for each camera to quantify different types of errors. For each experiment, we outline the basic setup, present comparable data for each camera, and discuss the respective results. The results discussed in this paper enable the community to make appropriate decisions in choosing the best matching camera for a certain application. This work also lays the foundation for a framework to benchmark future ToF cameras. Furthermore, our results demonstrate the necessity for correcting characteristic measurement errors. We believe that the presented findings will allow 1) the development of novel correction methods for specific errors and 2) the development of general data processing algorithms that are able to robustly operate on a wider range of cameras and scenes.

[1]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[2]  Achim J. Lilienthal,et al.  Comparative Evaluation of Range Sensor Accuracy in Indoor Environments , 2011, ECMR.

[3]  Marvin Lindner,et al.  Calibration and real-time processing of time-of-flight range data , 2010 .

[4]  D. Lichti,et al.  MODELLING SCATTERING DISTORTION IN 3D RANGE CAMERA , 2010 .

[5]  Radu Horaud,et al.  Time-of-Flight Cameras , 2012, SpringerBriefs in Computer Science.

[6]  Elise Lachat,et al.  Assessment and Calibration of a RGB-D Camera (Kinect v2 Sensor) Towards a Potential Use for Close-Range 3D Modeling , 2015, Remote. Sens..

[7]  Norbert Pfeifer,et al.  Modelling and Compensating Internal Light Scattering in Time of Flight Range Cameras , 2012 .

[8]  Andreas Zell,et al.  A Comparison of 3D Sensors for Wheeled Mobile Robots , 2014, IAS.

[9]  Reinhard Koch,et al.  Technical Foundation and Calibration Methods for Time-of-Flight Cameras , 2013, Time-of-Flight and Depth Imaging.

[10]  Filiberto Chiabrando,et al.  SR-4000 TOF camera: further experimental tests and first applications to metric survey , 2010 .

[11]  Elli Angelopoulou,et al.  ROCHADE: Robust Checkerboard Advanced Detection for Camera Calibration , 2014, ECCV.

[12]  Lin Yang,et al.  Evaluating and Improving the Depth Accuracy of Kinect for Windows v2 , 2015, IEEE Sensors Journal.

[13]  Derek D. Lichti,et al.  3D Cameras: Errors, Calibration and Orientation , 2013 .

[14]  Mirko Schmidt,et al.  SRA: Fast Removal of General Multipath for ToF Sensors , 2014, ECCV.

[15]  Fulvio Rinaudo,et al.  SR-4000 and CamCube3.0 Time of Flight (ToF) Cameras: Tests and Comparison , 2012, Remote. Sens..

[16]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Andreas Kolb,et al.  Kinect range sensing: Structured-light versus Time-of-Flight Kinect , 2015, Comput. Vis. Image Underst..

[18]  Radu Horaud,et al.  Time-of-Flight Cameras: Principles, Methods and Applications , 2012 .

[19]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[20]  Derek D. Lichti,et al.  A study of systematic errors in the PMD CamBoard nano , 2013, Optical Metrology.

[21]  Michael J. Cree,et al.  Separating true range measurements from multi-path and scattering interference in commercial range cameras , 2011, Electronic Imaging.

[22]  Jens T. Thielemann,et al.  Modelling and compensating measurement errors caused by scattering in time-of-flight cameras , 2008, Optical Engineering + Applications.

[23]  Ramesh Raskar,et al.  Resolving Multi-path Interference in Time-of-Flight Imaging via Modulation Frequency Diversity and Sparse Regularization , 2014, Optics letters.

[24]  Heinz Hügli,et al.  Real-time scattering compensation for time-of-flight camera , 2007, ICVS 2007.