Comparison of depth cameras for three-dimensional reconstruction in medicine

KinectFusion is a typical three-dimensional reconstruction technique which enables generation of individual three-dimensional human models from consumer depth cameras for understanding body shapes. The aim of this study was to compare three-dimensional reconstruction results obtained using KinectFusion from data collected with two different types of depth camera (time-of-flight and stereoscopic cameras) and compare these results with those of a commercial three-dimensional scanning system to determine which type of depth camera gives improved reconstruction. Torso mannequins and machined aluminium cylinders were used as the test objects for this study. Two depth cameras, Microsoft Kinect V2 and Intel Realsense D435, were selected as the representatives of time-of-flight and stereoscopic cameras, respectively, to capture scan data for the reconstruction of three-dimensional point clouds by KinectFusion techniques. The results showed that both time-of-flight and stereoscopic cameras, using the developed rotating camera rig, provided repeatable body scanning data with minimal operator-induced error. However, the time-of-flight camera generated more accurate three-dimensional point clouds than the stereoscopic sensor. Thus, this suggests that applications requiring the generation of accurate three-dimensional human models by KinectFusion techniques should consider using a time-of-flight camera, such as the Microsoft Kinect V2, as the image capturing sensor.

[1]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[2]  Jonathan T. Barron,et al.  3D self-portraits , 2013, ACM Trans. Graph..

[3]  J S Wheat,et al.  Development and assessment of a Microsoft Kinect based system for imaging the breast in three dimensions. , 2014, Medical engineering & physics.

[4]  Paolo Cignoni,et al.  MeshLab: 3D triangular meshes processing and editing , 2017 .

[5]  Roland Siegwart,et al.  Kinect v2 for mobile robot navigation: Evaluation and modeling , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[6]  Matthias Nießner,et al.  State of the Art on 3D Reconstruction with RGB‐D Cameras , 2018, Comput. Graph. Forum.

[7]  S B Heymsfield,et al.  Clinically applicable optical imaging technology for body size and shape analysis: comparison of systems differing in design , 2017, European Journal of Clinical Nutrition.

[8]  Bugao Xu,et al.  Novel Body Shape Descriptors for Abdominal Adiposity Prediction Using Magnetic Resonance Images and Stereovision Body Images , 2017, Obesity.

[9]  Livio Pinto,et al.  Calibration of Kinect for Xbox One and Comparison between the Two Generations of Microsoft Sensors , 2015, Sensors.

[10]  Simon Choppin,et al.  Validity and repeatability of a depth camera-based surface imaging system for thigh volume measurement , 2016, Journal of sports sciences.

[11]  Taku Komura,et al.  3D textile reconstruction based on KinectFusion and synthesized texture , 2017 .

[12]  Petros Pandis,et al.  A low-cost three-dimensional laser surface scanning approach for defining body segment parameters , 2017, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[13]  Sungmin Kim,et al.  Development of low cost three-dimensional body scanner using depth perception camera , 2017 .

[14]  Taku Komura,et al.  Scanning and animating characters dressed in multiple-layer garments , 2017, The Visual Computer.

[15]  Jacqueline Alderson,et al.  DIFFERENTIATION OF THE ENERGETIC PARAMETERS BETWEEN MALE AND FEMALE ELITE POLE VAULTERS , 2016 .

[16]  Anders Grunnet-Jepsen,et al.  Intel(R) RealSense(TM) Stereoscopic Depth Cameras , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  Tim Olds,et al.  Is three-dimensional anthropometric analysis as good as traditional anthropometric analysis in predicting junior rowing performance? , 2012, Journal of sports sciences.

[18]  Arthur D. Stewart Kinanthropometry and body composition: A natural home for three-dimensional photonic scanning , 2010, Journal of sports sciences.

[19]  Didier Stricker,et al.  Comparison of Kinect V1 and V2 Depth Images in Terms of Accuracy and Precision , 2016, ACCV Workshops.

[20]  B K Ng,et al.  Clinical anthropometrics and body composition from 3D whole-body surface scans , 2016, European Journal of Clinical Nutrition.

[21]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[22]  Ajmal S. Mian,et al.  Using Kinect for face recognition under varying poses, expressions, illumination and disguise , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[23]  Jin Cheng Zhu,et al.  3D Human Body Data Acquisition and Fit Evaluation of Clothing , 2014, CIT 2014.

[24]  Andreas Kolb,et al.  Kinect range sensing: Structured-light versus Time-of-Flight Kinect , 2015, Comput. Vis. Image Underst..

[25]  Philip C. Treleaven,et al.  3D Body Scanning and Healthcare Applications , 2007, Computer.

[26]  Alice May Bullas,et al.  The importance of complex anthropometrics in the assessment of cyclists , 2017 .

[27]  Ming C. Lin,et al.  Example-guided physically based modal sound synthesis , 2013, ACM Trans. Graph..

[28]  Pedro Arias,et al.  Metrological comparison between Kinect I and Kinect II sensors , 2015 .

[29]  P. Treleaven,et al.  Body shape by 3-D photonic scanning in Thai and UK adults: comparison of national sizing surveys , 2012, International Journal of Obesity.

[30]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[31]  Konstantinos G. Derpanis,et al.  Overview of the RANSAC Algorithm , 2005 .

[32]  Geng Wang,et al.  Applications of RGB-D data for 3D reconstruction in the indoor environment , 2016, 2016 IEEE Chinese Guidance, Navigation and Control Conference (CGNCC).

[33]  Kathleen M. Robinette,et al.  The CAESAR project: a 3-D surface anthropometry survey , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[34]  Ben Heller,et al.  Calculating body segment inertia parameters from a single rapid scan using the Microsoft Kinect , 2012 .

[35]  Ross H Sanders,et al.  The effect of pose variability and repeated reliability of segmental centres of mass acquisition when using 3D photonic scanning , 2016, Ergonomics.

[36]  Guanglong Du,et al.  A Markerless Human–Robot Interface Using Particle Filter and Kalman Filter for Dual Robots , 2015, IEEE Transactions on Industrial Electronics.

[37]  Mao-Jiun J. Wang,et al.  The development of a clothing fit evaluation system under virtual environment , 2015, Multimedia Tools and Applications.

[38]  Francesco Luke Siena,et al.  Utilising the Intel RealSense Camera for Measuring Health Outcomes in Clinical Research , 2018, Journal of Medical Systems.

[39]  Ping Zhang,et al.  Human–Manipulator Interface Based on Multisensory Process via Kalman Filters , 2014, IEEE Transactions on Industrial Electronics.

[40]  Xin Liu,et al.  Markerless Human–Manipulator Interface Using Leap Motion With Interval Kalman Filter and Improved Particle Filter , 2016, IEEE Transactions on Industrial Informatics.

[41]  L D Montgomery,et al.  Comparison of upper limb volume measurement techniques and arm symptoms between healthy volunteers and individuals with known lymphedema. , 2007, Lymphology.