Using a smartphone camera to analyse rotating and vibrating systems: Feedback on the SURVISHNO 2019 contest

Abstract A smartphone is a low-cost pocket wireless multichannel multiphysical data acquisition system: the use of such a device for noise and vibration analysis is a challenging task. To what extent is it possible to carry out relevant analysis from it? The Survishno conference, held in Lyon in July 2019, proposed a contest to participants based on this subject. Two challenges were proposed, wherein each a mute video showing an object moving/excited at different frequencies was provided. Due to the frequencies set and the video sampling characteristics, special effects occurred and are visible on both videos. From the first video, participants were asked to estimate the Instantaneous Angular Speed (IAS) of a rotating fan. From the second video, they were asked to perform the modal analysis of a cantilever beam. This paper gathers the interesting ideas proposed by the contestants and proposes a global method to solve these two problems. One major point of the paper might be the advantageous use of the rolling shutter effect, a well-known artefact of smartphone videos, to perform advanced mechanical analyses: the consideration of the unavoidable slight phase shift between the acquisition of each pixel opens up the possibility to perform a dynamic analysis at frequencies that are much higher than the video frame rate.

[1]  Alessandro Rivola,et al.  Zebra tape identification for the instantaneous angular speed computation and angular resampling of motorbike valve train measurements , 2014 .

[2]  Steven B. Leeb,et al.  Review and comparison of tacholess instantaneous speed estimation methods on experimental vibration data , 2019, Mechanical Systems and Signal Processing.

[3]  Marco Grossi,et al.  A sensor-centric survey on the development of smartphone measurement and sensing systems , 2019, Measurement.

[4]  Amir Hossein Alavi,et al.  An overview of smartphone technology for citizen-centered, real-time and scalable civil infrastructure monitoring , 2019, Future Gener. Comput. Syst..

[5]  Quentin Leclere,et al.  A multi-order probabilistic approach for Instantaneous Angular Speed tracking debriefing of the CMMNO׳14 diagnosis contest , 2016 .

[6]  David J. Ewins,et al.  Modal testing using impact excitation and a scanning LDV , 1998, Other Conferences.

[7]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Meenakshisundaram Gopi,et al.  Correcting perceived perspective distortions using object specific planar transformations , 2016, 2016 IEEE International Conference on Computational Photography (ICCP).

[9]  Derek Bradley,et al.  Adaptive Thresholding using the Integral Image , 2007, J. Graph. Tools.

[10]  S. D. Yu,et al.  A data processing method for determining instantaneous angular speed and acceleration of crankshaft in an aircraft engine–propeller system using a magnetic encoder , 2010 .

[11]  Pascal Monasse,et al.  High-precision camera distortion measurements with a "calibration harp". , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Alessandro Paolo Daga,et al.  GA-Adaptive Template Matching for Offline Shape Motion Tracking Based on Edge Detection: IAS Estimation from the SURVISHNO 2019 Challenge Video for Machine Diagnostics Purposes , 2020, Algorithms.

[13]  Peter Thomson,et al.  Frequencies and damping ratios of bridges through Operational Modal Analysis using smartphones , 2018, Construction and Building Materials.

[14]  Robert B. Randall,et al.  Editorial for the special issue on Instantaneous Angular Speed (IAS) processing and angular applications , 2014 .

[15]  Toby Terpstra,et al.  An Evaluation of Two Methodologies for Lens Distortion Removal when EXIF Data is Unavailable , 2017 .

[16]  Cem Ersoy,et al.  Stress detection in daily life scenarios using smart phones and wearable sensors: A survey , 2019, J. Biomed. Informatics.

[17]  Chulmin Joo,et al.  Smart Fatigue Phone: Real-time estimation of driver fatigue using smartphone-based cortisol detection. , 2019, Biosensors & bioelectronics.

[18]  Alessandro Paolo Daga,et al.  Feedback on the Surveillance 8 challenge: Vibration-based diagnosis of a Safran aircraft engine , 2017 .

[19]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[20]  Charles R. Farrar,et al.  MICROWAVE INTERFEROMETERS FOR NON-CONTACT VIBRATION MEASUREMENTS ON LARGE STRUCTURES , 1999 .

[21]  Salvatore Tabbone,et al.  Camera-captured document image perspective distortion correction using vanishing point detection based on Radon transform , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[22]  Frédéric Bonnardot.  Influence of Speed Fluctuation on Cepstrum , 2017 .

[23]  John E. Madias,et al.  A proposal for monitoring patients with heart failure via "smart phone technology"-based electrocardiograms. , 2016, Journal of electrocardiology.

[24]  Frédo Durand,et al.  Modal identification of simple structures with high-speed video using motion magnification , 2015 .

[25]  Denis Zorin,et al.  Correction of geometric perceptual distortions in pictures , 1995, SIGGRAPH.

[26]  Andrew Shennan,et al.  The role of medical smartphone apps in clinical decision-support: A literature review , 2019, Artif. Intell. Medicine.