Static and dynamic displacement measurements of structural elements using low cost RGB-D cameras

Abstract Optical displacement measurements can provide data of the behavior of structural elements without altering key parameters such as damping, stiffness, or mass. Optical techniques can also reduce costs and substantially simplify the equipment required to acquire data effectively and map displacements at specific locations of elements with complex geometries, such as steel connections. In addition, these techniques can provide simultaneous data at multiple points using a single device, hence lowering instrumentation costs. For example, motion capture systems are used in applications that range from medicine to cinematography, and involve different types of imaging techniques. However, their application to civil and mechanical structures is complex and costly. On the other hand, range/depth cameras can provide a 3-D imaging solution to capture motion at an affordable cost. These cameras are widely available and used in the videogame industry. This paper presents the characterization and implementation of a methodology for the measurement of large-displacements using artificial vision techniques, for structural applications such as experimental modal analysis, cyclic loading tests, creep tests, and static displacements tests. Two low cost depth-cameras, one a time-of-flight camera and the other a structured light camera, were calibrated, evaluated and implemented in static and dynamic tests, during a full-scale reinforced concrete wall cyclic load test and shaking table tests. The results show that both devices provide high accuracy measurements in comparison with commonly used sensors for displacement measurements, with the added advantages of being contactless and providing three-dimensional information.

[1]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[2]  Rui Calçada,et al.  Non-contact measurement of the dynamic displacement of railway bridges using an advanced video-based system , 2014 .

[3]  Chan-Soo Park,et al.  Comparison of plane extraction performance using laser scanner and Kinect , 2011, 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[4]  Lin Yang,et al.  Evaluating and Improving the Depth Accuracy of Kinect for Windows v2 , 2015, IEEE Sensors Journal.

[5]  Li Bin,et al.  Study on the measurement of in-plane displacement of solid surfaces by laser Doppler velocimetry , 1995 .

[6]  Takayuki Nakamura Real-time 3-D object tracking using Kinect sensor , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[7]  Kourosh Khoshelham,et al.  Accuracy analysis of kinect depth data , 2012 .

[8]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[9]  H. Macher,et al.  FIRST EXPERIENCES WITH KINECT V2 SENSOR FOR CLOSE RANGE 3D MODELLING , 2015 .

[10]  Christian Maria Firrone,et al.  Measurement of the kinematics of two underplatform dampers with different geometry and comparison with numerical simulation , 2009 .

[11]  Horst Bischof,et al.  μNect: On using a gaming RGBD camera in micro-metrology applications , 2011, CVPR 2011 WORKSHOPS.

[12]  Franccois Hild,et al.  Digital Image Correlation: from Displacement Measurement to Identification of Elastic Properties – a Review , 2006 .

[13]  Angel J. Pino-Velazquez,et al.  Displacements measurement in a building model using the speckle photography technique , 2005 .

[14]  Xiaoyong Liu,et al.  Subpixel In-Plane Displacement Measurement Using Digital Image Correlation and Artificial Neural Networks , 2010, 2010 Symposium on Photonics and Optoelectronics.

[15]  Marcus A. Magnor,et al.  The capturing of turbulent gas flows using multiple Kinects , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[16]  Markus Vincze,et al.  Surface reconstruction for RGB-D data using real-time depth propagation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[17]  Thomas Butkiewicz Low-cost coastal mapping using Kinect v2 time-of-flight cameras , 2014, 2014 Oceans - St. John's.

[18]  Hongbing Lu,et al.  Surface deformation measurements of a cylindrical specimen by digital image correlation , 1997 .

[19]  Luigi Gallo,et al.  Low-Cost Augmented Reality Systems via 3D Point Cloud Sensors , 2011, 2011 Seventh International Conference on Signal Image Technology & Internet-Based Systems.

[20]  D. J. Ewins,et al.  Detecting damage in vibrating structures with a scanning LDV , 1999 .

[21]  Attawith Sudsang,et al.  Plane detection for Kinect image sequences , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[22]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[23]  Oral Büyüköztürk,et al.  Output-only computer vision based damage detection using phase-based optical flow and unscented Kalman filters , 2017 .

[24]  Zhengyou Zhang,et al.  Calibration between depth and color sensors for commodity depth cameras , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[25]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[26]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[27]  Juho Kannala,et al.  Joint Depth and Color Camera Calibration with Distortion Correction , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Luigi Gallo,et al.  3D point cloud sensors for low-cost medical in-situ visualization , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[29]  D. Garcia,et al.  A combined temporal tracking and stereo-correlation technique for accurate measurement of 3D displacements: application to sheet metal forming , 2002 .

[30]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[31]  John Tyson,et al.  Pull-field dynamic displacement and strain measurement using advanced 3D image correlation photogrammetry: Part 1 , 2003 .

[32]  Philippe Lucidarme,et al.  On the use of depth camera for 3D phenotyping of entire plants , 2012 .

[33]  Lijun Wu,et al.  Dynamic testing of a laboratory model via vision-based sensing , 2014 .

[34]  Roland Siegwart,et al.  Conference Presentation Slides on Kinect v2 for Mobile Robot Navigation: Evaluation and Modeling , 2015 .