Metrological evaluation of KinectFusion and its comparison with Microsoft Kinect sensor

Abstract In recent years the use of low cost sensors like Microsoft Kinect in the engineering field is growing day by day. Its use as a measurement device, capable of generating geometric data in close-range environment has been already validated. KinectFusion is a software that is able to capture a complete dataset of a 3D scene reconstruction using the Microsoft Kinect depth sensor at a very low cost. In this work, a metrological geometric verification of the KinectFusion implementation is performed using a standard artefact which consists of five delrin spheres and seven aluminum cubes. Accuracy and precision tests at different resolutions and ranges were performed to assess the metrological behavior of KinectFusion and compare it with the Microsoft Kinect depth sensor. The analysis reveals that both approaches yield a decrease in precision and accuracy with increasing range between sensor and object. Measurement of the length between the centers of the spheres was used for accuracy assessment. Taking into account the farthest sphere, an increasing trend of the accuracy with the distance was obtained for KinectFusion dataset, independently of the 3D model resolution and the range. By contrast, this trend is not shown for Kinect depth sensor dataset. KinectFusion precision results are better than the obtained with Kinect stand alone sensor. Besides that, precision values for KinectFusion are proportional to the resolution of the 3D model. KinectFusion algorithm provides a suitable 3D model of the scene that can be used for engineering applications where accuracy requirements are not very strict.

[1]  Thijs Vandenryt,et al.  Waving at the Heart: Implementation of a Kinect-based real-time interactive control system for viewing cineangiogram loops during cardiac catheterization procedures , 2013, Computing in Cardiology 2013.

[2]  Pushmeet Kohli,et al.  When Can We Use KinectFusion for Ground Truth Acquisition , 2012 .

[3]  C. S. Lee,et al.  Simultaneous localization and mapping algorithms with environmental-structure prediction for single- and multi-robot systems , 2007 .

[4]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[5]  G. Baron,et al.  Gesture and voice driven mobile tribot robot using Kinect sensor , 2013, 2013 International Symposium on Electrodynamic and Mechatronic Systems (SELM).

[6]  Mark D. Semon,et al.  POSTUSE REVIEW: An Introduction to Error Analysis: The Study of Uncertainties in Physical Measurements , 1982 .

[7]  Jana Abhijit Kinect for Windows SDK Programming Guide , 2012 .

[8]  Kingshuk Chakravarty,et al.  Person Identification using Skeleton Information from Kinect , 2013, ACHI 2013.

[9]  Pedro Arias,et al.  Metrological evaluation of Microsoft Kinect and Asus Xtion sensors , 2013 .

[10]  Yi Li,et al.  Hand gesture recognition using Kinect , 2012, 2012 IEEE International Conference on Computer Science and Automation Engineering.

[11]  Pedro Arias,et al.  Standard artifact for the geometric verification of terrestrial laser scanning systems , 2011 .

[12]  Erdal Oruklu,et al.  3D image reconstruction and human body tracking using stereo vision and Kinect technology , 2012, 2012 IEEE International Conference on Electro/Information Technology.

[13]  Daniel O. Sales,et al.  Mobile Robots Navigation in Indoor Environments Using Kinect Sensor , 2012, 2012 Second Brazilian Conference on Critical Embedded Systems.

[14]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[15]  Pedro Arias,et al.  Verification artifact for photogrammetric measurement systems , 2011 .

[16]  Junsong Yuan,et al.  Robust hand gesture recognition with kinect sensor , 2011, ACM Multimedia.

[17]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Pedro Arias,et al.  Accuracy verification of the Lynx Mobile Mapper system , 2013 .