RGB-D-DIC technique for low-cost 3D displacement fields measurements

Abstract Optical displacement measurements can provide data on the behavior of structural elements without altering key parameters such as damping, stiffness, and mass. Optical techniques can also substantially simplify the equipment that is required for acquiring data effectively and can map displacements at specified locations of elements with complex geometries, such as steel connections. In addition, these techniques can provide simultaneous data at multiple points using a single imaging device (for plane measurements) or multiple devices (for three-dimensional measurements); however, these systems rely on specialized imaging sensors that are coupled with expensive optics and high-cost software licenses. In contrast, range/depth cameras (RGB-D) can provide a color and 3D imaging solution for capturing motion at an affordable cost. These cameras are widely available and applied in the video game industry using a mass production scheme; hence, they are of low cost. This paper proposes a methodology, along with an experimental validation, of a large three-dimensional displacement field measurement approach that uses artificial vision techniques. This methodology uses digital image correlation (DIC) principles and an RGB-D camera (RGB-D-DIC) for a variety of structural applications, which range from experimental modal analysis, cyclic loading tests, and creep tests to static displacement tests. A low-cost Kinect V2 camera was single- and stereo-calibrated, evaluated and implemented in a comparison test with a commercial three-dimensional DIC system. With the RGB-D camera, the proposed methodology can provide accurate displacement measurements that are comparable to those that are obtained via precise displacement measurement techniques and/or by using sensors; further, this methodology has the advantages of low cost, ease of implementation, and contactless measurement and provides three-dimensional information.

[1]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Mark F. Green,et al.  Fiber Optic Sensors and Digital Image Correlation for Measuring Deformations in Reinforced Concrete Beams , 2018 .

[3]  Lianxiang Yang,et al.  3D digital image correlation using single color camera pseudo-stereo system , 2017 .

[4]  Hyo Seon Park,et al.  Deformation Monitoring of a Building Structure Using a Motion Capture System , 2015, IEEE/ASME Transactions on Mechatronics.

[5]  David A. Ehrhardt,et al.  High-speed 3D digital image correlation vibration measurement: Recent advancements and noted limitations , 2017 .

[6]  Katia Genovese,et al.  Stereo-Digital Image Correlation (DIC) measurements with a single camera using a biprism , 2013 .

[7]  Juan R. Terven,et al.  A multiple camera calibration and point cloud fusion tool for Kinect V2 , 2017, Sci. Comput. Program..

[8]  Liping Yu,et al.  Color Stereo-Digital Image Correlation Method Using a Single 3CCD Color Camera , 2017, Experimental Mechanics.

[9]  D. Doman,et al.  A New Video Extensometer System for Testing Materials Undergoing Severe Plastic Deformation , 2018 .

[10]  Jean Michel Franco,et al.  Use of a Depth Camera as a Contactless Displacement Field Sensor , 2016 .

[11]  Jean Michel Franco,et al.  Static and dynamic displacement measurements of structural elements using low cost RGB-D cameras , 2017 .

[12]  L. Felipe-Sesé,et al.  Integration of Fringe Projection and 2D Digital Image Correlation for the measurement of 3D displacements and strains , 2017 .

[13]  Jung-Hoon Kim,et al.  3D displacement measurement model for health monitoring of structures using a motion capture system , 2015 .

[14]  L. Gothard,et al.  Low‐cost Kinect Version 2 imaging system for breath hold monitoring and gating: Proof of concept study for breast cancer VMAT radiotherapy , 2018, Journal of applied clinical medical physics.

[15]  L. Daniel,et al.  Development of a 2D DIC Experimental Tool for Piezoelectric Strains Measurements , 2017 .

[16]  Kunihiro Chihara,et al.  Whole Shape Measurement System Using a Single Camera and a Cylindrical Mirror , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Jordi Llorens,et al.  Kinect v2 Sensor-Based Mobile Terrestrial Laser Scanner for Agricultural Outdoor Applications , 2017, IEEE/ASME Transactions on Mechatronics.

[18]  D. Guildenbecher,et al.  Comparison of three-dimensional particle tracking and sizing using plenoptic imaging and digital in-line holography. , 2016, Applied optics.

[19]  Mohammad R. Jahanshahi,et al.  Color and depth data fusion using an RGB‐D sensor for inexpensive and contactless dynamic displacement‐field measurement , 2018 .

[20]  Juan R. Terven,et al.  Kin2. A Kinect 2 toolbox for MATLAB , 2016, Sci. Comput. Program..

[21]  Arkadiusz Kwiecień,et al.  Application of Digital Image Correlation to composite reinforcements testing , 2017 .

[22]  Bing Pan,et al.  Digital image correlation for surface deformation measurement: historical developments, recent advances and future goals , 2018, Measurement Science and Technology.

[23]  Changhee Kim,et al.  Color and Depth Image Correspondence for Kinect v2 , 2016 .

[24]  Václav Krys,et al.  Kinect v2 infrared images correction , 2018 .

[25]  In-Ho Jeon,et al.  Digital data acquisition of shoulder range of motion and arm motion smoothness using Kinect v2. , 2017, Journal of shoulder and elbow surgery.

[26]  Xin Kang,et al.  Single Camera 3D Digital Image Correlation Using a Polarized System , 2018 .

[27]  Maurice Whelan,et al.  Calibration and evaluation of optical systems for full-field strain measurement , 2007 .

[28]  M. Sutton,et al.  Full-Field Deformation Measurement and Crack Mapping on Confined Masonry Walls Using Digital Image Correlation , 2014, Experimental Mechanics.

[29]  Liping Yu,et al.  Structure parameter analysis and uncertainty evaluation for single-camera stereo-digital image correlation with a four-mirror adapter. , 2016, Applied optics.

[30]  Michael A. Sutton,et al.  The effect of out-of-plane motion on 2D and 3D digital image correlation measurements , 2008 .

[31]  Ryad Benosman,et al.  Plenoptic cameras in real-time robotics , 2013, Int. J. Robotics Res..

[32]  M. Sutton,et al.  Full-field speckle pattern image correlation with B-Spline deformation function , 2002 .

[33]  Zhanwei Liu,et al.  Centrosymmetric 3D Deformation Measurement using Grid Method with a Single-Camera , 2017 .

[34]  Thomas Becker,et al.  High-speed digital image correlation: error estimations and applications , 2007 .

[35]  Wu Chen,et al.  A New Calibration Method for Commercial RGB-D Sensors , 2017, Sensors.

[36]  Uvais Qidwai,et al.  3D dynamic displacement-field measurement for structural health monitoring using inexpensive RGB-D based sensor , 2017 .

[37]  Fabio Matta,et al.  Recent Progress in Digital Image Correlation: Background and Developments since the 2013 W M Murray Lecture , 2017 .

[38]  Hugh M. Herr,et al.  MultiDIC: An Open-Source Toolbox for Multi-View 3D Digital Image Correlation , 2018, IEEE Access.

[39]  Hyo Seon Park,et al.  Vision-based system identification technique for building structures using a motion capture system , 2015 .

[40]  Pankaj Bhowmik,et al.  An approach to detect branches and seedpods based on 3D image in low-cost plant phenotyping platform , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[41]  Peter Avitabile,et al.  Full-field dynamic strain prediction on a wind turbine using displacements of optical targets measured by stereophotogrammetry , 2015 .

[42]  Oh-Heon Kwon,et al.  Mechanical Properties Identification of Sheet Metals by 2D-Digital Image Correlation Method , 2017 .

[43]  J. Soria,et al.  Light-field camera-based 3D volumetric particle image velocimetry with dense ray tracing reconstruction technique , 2017 .

[44]  José Dorado,et al.  Influence of Wind Speed on RGB-D Images in Tree Plantations , 2017, Sensors.

[45]  In-So Kweon,et al.  A novel stereo camera system by a biprism , 2000, IEEE Trans. Robotics Autom..

[46]  Yong Su,et al.  Precise 3D shape measurement of three-dimensional digital image correlation for complex surfaces , 2018 .

[47]  Qianbing Zhang,et al.  Review of single-camera stereo-digital image correlation techniques for full-field 3D shape and deformation measurement , 2018 .

[48]  Jitendra Malik,et al.  Depth from Combining Defocus and Correspondence Using Light-Field Cameras , 2013, 2013 IEEE International Conference on Computer Vision.

[49]  Chenggen Quan,et al.  3D digital image correlation using a single 3CCD colour camera and dichroic filter , 2018 .

[50]  I. Obeid,et al.  Kinect v2 accuracy as a body segment measuring tool , 2017, 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[51]  Peter Avitabile,et al.  Photogrammetry and optical methods in structural dynamics – A review , 2017 .

[52]  Elías López-Alba,et al.  Modal Parameters Evaluation in a Full-Scale Aircraft Demonstrator under Different Environmental Conditions Using HS 3D-DIC , 2018, Materials.

[53]  Didier Stricker,et al.  Comparison of Kinect V1 and V2 Depth Images in Terms of Accuracy and Precision , 2016, ACCV Workshops.

[54]  D. C. Brown,et al.  Lens distortion for close-range photogrammetry , 1986 .

[55]  Bing Pan,et al.  Single-camera stereo-digital image correlation with a four-mirror adapter: optimized design and validation , 2016 .

[56]  Wenbing Zhao,et al.  Kinect Applications in Healthcare , 2018 .

[57]  Bing Pan,et al.  Full-Field Surface 3D Shape and Displacement Measurements Using an Unfocused Plenoptic Camera , 2018 .

[58]  James M. W. Brownjohn,et al.  Review of machine-vision based methodologies for displacement measurement in civil structures , 2018 .