Investigating the impact of a motion capture system on Microsoft Kinect v2 recordings: A caution for using the technologies together

Microsoft Kinect sensors are considered to be low-cost popular RGB-D sensors and are widely employed in various applications. Consequently, several studies have been conducted to evaluate the reliability and validity of Microsoft Kinect sensors, and noise models have been proposed for the sensors. Several studies utilized motion capture systems as a golden standard to assess the Microsoft Kinect sensors, and none of them reported interference between Kinect sensors and motion capture systems. This study aimed to investigate possible interference between a golden standard (i.e., Qualisys) and Microsoft Kinect v2. The depth recordings of Microsoft Kinect sensors were processed to estimate the intensity of interference. A flat non-reflective surface was utilized, and smoothness of the surface was measured using Microsoft Kinect v2 in absence and presence of an active motion capture system. The recording was repeated in five different distances. The results indicated that Microsoft Kinect v2 is distorted by the motion capture system and the distortion is increasing by increasing distance between Kinect and region of interest. Regarding the results, it can be concluded that the golden standard motion capture system is robust against interference from the Microsoft Kinect sensors.

[1]  Shahram Izadi,et al.  Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[2]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[3]  Andreas Kolb,et al.  Kinect range sensing: Structured-light versus Time-of-Flight Kinect , 2015, Comput. Vis. Image Underst..

[4]  M. Hunt,et al.  Validity of the Microsoft Kinect for providing lateral trunk lean feedback during gait retraining. , 2013, Gait & posture.

[5]  George Azzari,et al.  Rapid Characterization of Vegetation Structure with a Microsoft Kinect Sensor , 2013, Sensors.

[6]  Martin Kampel,et al.  Performance evaluation of joint angles obtained by the Kinect v2 , 2015 .

[7]  Albert A. Rizzo,et al.  Towards pervasive physical rehabilitation using Microsoft Kinect , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[8]  Mansib Rahman,et al.  Beginning Microsoft Kinect for Windows SDK 2.0 , 2017, Apress.

[9]  Roland Siegwart,et al.  Kinect v2 for mobile robot navigation: Evaluation and modeling , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[10]  Peter A. Beling,et al.  Statistical Analysis-Based Error Models for the Microsoft Kinect™ Depth Sensor , 2014, Sensors.

[11]  Jidong Huang,et al.  Study on the use of Microsoft Kinect for robotics applications , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[12]  Tal Jarus,et al.  Virtual reality as balance rehabilitation for children with brain injury: A case study , 2013 .

[13]  J P Cobb,et al.  Validity and sensitivity of the longitudinal asymmetry index to detect gait asymmetry using Microsoft Kinect data. , 2017, Gait & posture.

[14]  Kirk Woolford,et al.  Defining accuracy in the use of Kinect v2 for exercise monitoring , 2015, MOCO.

[15]  Michael Riis Andersen,et al.  Kinect Depth Sensor Evaluation for Computer Vision Applications , 2012 .

[16]  John Sell,et al.  The Xbox One System on a Chip and Kinect Sensor , 2014, IEEE Micro.

[17]  Bernd Heinlein,et al.  Accuracy of KinectOne to quantify kinematics of the upper body. , 2016, Gait & posture.

[18]  Saeid Nahavandi,et al.  Measuring depth accuracy in RGBD cameras , 2013, 2013, 7th International Conference on Signal Processing and Communication Systems (ICSPCS).

[19]  Partha Pratim Das,et al.  Estimation of the orientation and distance of a mirror from Kinect depth data , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[20]  Albert A. Rizzo,et al.  Interactive game-based rehabilitation using the Microsoft Kinect , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[21]  Melvyn Roerdink,et al.  Kinematic Validation of a Multi-Kinect v2 Instrumented 10-Meter Walkway for Quantitative Gait Assessments , 2015, PloS one.

[22]  Antonio Fernández-Caballero,et al.  Multi-camera systems for rehabilitation therapies: a study of the precision of Microsoft Kinect sensors , 2016, Frontiers of Information Technology & Electronic Engineering.

[23]  Mihai Budiu,et al.  Parallelizing the Training of the Kinect Body Parts Labeling Algorithm , 2011 .

[24]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[25]  Xu Xu,et al.  Accuracy of the Microsoft Kinect for measuring gait parameters during treadmill walking. , 2015, Gait & posture.

[26]  Ross A Clark,et al.  Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables. , 2015, Journal of biomechanics.

[27]  Andrew W. Fitzgibbon,et al.  Efficient regression of general-activity human poses from depth images , 2011, 2011 International Conference on Computer Vision.

[28]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[29]  James A. Michener.  Evaluation of Microsoft Kinect 360 and Microsoft Kinect One for robotics and computer vision applications , 2014 .

[30]  Christian Riess,et al.  A Comparative Error Analysis of Current Time-of-Flight Sensors , 2016, IEEE Transactions on Computational Imaging.

[31]  Moataz Eltoukhy,et al.  Improved kinect-based spatiotemporal and kinematic treadmill gait assessment. , 2017, Gait & posture.

[32]  Peter A. Beling,et al.  Simulating Kinect Infrared and Depth Images , 2016, IEEE Transactions on Cybernetics.

[33]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[34]  Partha Pratim Das,et al.  Characterizations of Noise in Kinect Depth Images: A Review , 2014, IEEE Sensors Journal.

[35]  Baining Guo,et al.  Exemplar-Based Human Action Pose Correction , 2014, IEEE Transactions on Cybernetics.

[36]  Francisco Javier Díaz-Pernas,et al.  Rehabilitation Using Kinect-based Games and Virtual Reality☆ , 2015 .

[37]  Franck Multon,et al.  Detection of gait cycles in treadmill walking using a Kinect. , 2015, Gait & posture.

[38]  M. Johnson,et al.  Circulating microRNAs in Sera Correlate with Soluble Biomarkers of Immune Activation but Do Not Predict Mortality in ART Treated Individuals with HIV-1 Infection: A Case Control Study , 2015, PloS one.

[39]  Ross A Clark,et al.  Reliability and concurrent validity of the Microsoft Xbox One Kinect for assessment of standing balance and postural control. , 2015, Gait & posture.

[40]  Andrew D. Payne,et al.  A 0.13 μm CMOS System-on-Chip for a 512 × 424 Time-of-Flight Image Sensor With Multi-Frequency Photo-Demodulation up to 130 MHz and 2 GS/s ADC , 2015, IEEE Journal of Solid-State Circuits.

[41]  José Luís Pimentel do Rosário,et al.  Biomechanical assessment of human posture: a literature review. , 2014, Journal of bodywork and movement therapies.

[42]  Livio Pinto,et al.  Calibration of Kinect for Xbox One and Comparison between the Two Generations of Microsoft Sensors , 2015, Sensors.

[43]  Elena Mugellini,et al.  Context-Aware 3D Gesture Interaction Based on Multiple Kinects , 2011 .

[44]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[45]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.