Methods and algorithms for video-based multi-point frequency measuring and mapping

Abstract Object vibrations and movements can be detected through changes in its luminance. In this paper, we demonstrate that we can obtain the vibration frequency of all vibrating targets in the sequence simultaneously through the analysis of local neighborhoods. The study is completed with a short-time Fourier analysis so that changes in the movement frequencies are also accounted. We also show that this information can be displayed like a color frequency map that can be superimposed to the video sequence providing a whole description of the analyzed sequence. The method can be used to analyze complex structures since their different vibrating parts can be visualized at a glance. The main algorithms, methods and some sequences are freely downloadable so that new applications and procedures can be implemented by the scientific community.

[1]  Steven W. Smith,et al.  The Scientist and Engineer's Guide to Digital Signal Processing , 1997 .

[2]  Jianwei Zhang,et al.  Obtaining four-dimensional vibration information for vibrating surfaces with a Kinect sensor , 2015 .

[3]  Chih-Chen Chang,et al.  Nontarget Image-Based Technique for Small Cable Vibration Measurement , 2008 .

[4]  Guido Luzi,et al.  A radar-based monitoring of the Collserola tower (Barcelona) , 2014 .

[5]  Hieu Nguyen,et al.  Audio extraction from silent high-speed video using an optical technique , 2014 .

[6]  Zhaoyang Wang,et al.  Digital image correlation in experimental mechanics and image registration in computer vision: Similarities, differences and complements , 2015 .

[7]  Frédo Durand,et al.  The visual microphone , 2014, ACM Trans. Graph..

[8]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[9]  Emanuele Zappa,et al.  Vibration Monitoring of Multiple Bridge Points by Means of a Unique Vision-Based Measuring System , 2014 .

[10]  David Mas,et al.  Resolution limits to object tracking with subpixel accuracy. , 2012, Optics letters.

[11]  Chandramouli Krishnan,et al.  A low cost real-time motion tracking approach using webcam technology. , 2015, Journal of biomechanics.

[12]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[13]  Salvador Ivorra,et al.  Optical Scanning for Structural Vibration Measurement , 2011 .

[14]  Jong-Jae Lee,et al.  A vision-based system for remote sensing of bridge displacement , 2006 .

[15]  David Mas,et al.  Vibration frequency measurement using a local multithreshold technique. , 2013, Optics express.

[16]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[17]  Carmelo Gentile,et al.  An interferometric radar for non-contact measurement of deflections on civil engineering structures: laboratory and full-scale tests , 2010 .

[18]  David Mas,et al.  Measurement of wide frequency range structural microvibrations with a pocket digital camera and sub-pixel techniques. , 2012, Applied optics.

[19]  Brian Wyvill,et al.  Robust iso-surface tracking for interactive character skinning , 2014, ACM Trans. Graph..

[20]  Carmelo Gentile,et al.  Deflection measurement on vibrating stay cables by non-contact microwave interferometer , 2010 .

[21]  Habib Tabatabai,et al.  Novel Applications of Laser Doppler Vibration Measurements to Medical Imaging , 2013, Sensing and imaging.

[22]  Elsa Caetano,et al.  A vision system for vibration monitoring of civil engineering structures , 2011 .

[23]  Maria Q. Feng,et al.  Vision-Based Displacement Sensor for Monitoring Dynamic Response Using Robust Object Search Algorithm , 2013 .