A comparison and analysis of RGB-D cameras' depth performance for robotics application

Consumer-grade RGB-D cameras capture RGB images along with per-pixel depth information, and because of their limited cost and ability to measure distances at a high frame rate, have been used in robotics and computer vision application. However, drawbacks include the repeatability and accuracy of RGB-D cameras for object detection and localization. This paper investigates and compares RGB-D cameras' performance in terms of depth image quality, depth clouds distribution, etc. performance and configuration methods of frequently used cameras, e.g. PrimeSense, Kinect V1 and Kinect V2, in order to provide useful advice when choosing a camera for robotic applications. Experimental and Point Cloud Library (PCL)-based methods are introduced for point-to-plane distance detection. Based on the obtained results, a relationship between measurements and ground truth is built.

[1]  Matteo Munaro,et al.  Performance evaluation of the 1st and 2nd generation Kinect for multimedia applications , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[2]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[3]  Carlo Tomasi.  Camera Calibration , 2002 .

[4]  Otmar Loffeld,et al.  Depth Camera Technology Comparison and Performance Evaluation , 2012, ICPRAM.

[5]  F. Zilly,et al.  Automated Restyling of Human Portrait Based on Facial Expression Recognition and 3D Reconstruction EE368 Project Proposal , 2016 .

[6]  Matteo Munaro,et al.  Fast and Robust Multi-people Tracking from RGB-D Data for a Mobile Robot , 2012, IAS.

[7]  Daniel Herrera C,et al.  Joint depth and color camera calibration with distortion correction. , 2012, IEEE transactions on pattern analysis and machine intelligence.

[8]  Lin Yang,et al.  Evaluating and Improving the Depth Accuracy of Kinect for Windows v2 , 2015, IEEE Sensors Journal.

[9]  Dieter Fox,et al.  Toward object discovery and modeling via 3-D scene comparison , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Roland Siegwart,et al.  Kinect v2 for mobile robot navigation: Evaluation and modeling , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[11]  Shahram Izadi,et al.  Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[12]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[13]  Xin Wang,et al.  Fast and robust mapping with low-cost Kinect V2 for photovoltaic panel cleaning robot , 2016, 2016 International Conference on Advanced Robotics and Mechatronics (ICARM).

[14]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).