An Estimation of Pedestrian Action on Footbridges Using Computer Vision Approaches

Vibration serviceability of footbridges is important in terms of fitness for purpose. Human-induced dynamic loading is the primary excitation of footbridges and has been researched with traditional sensors, such as inertial sensors and force plates. Along with the development of computer hardware and algorithms, e.g. machine learning, especially deep learning, computer vision technology improves rapidly and has potential application to the problem. High precision pedestrian detection can be realized with various computer vision methods, corresponding to different situations or demands. In this paper, two widely recognised computer vision approaches are used for detecting body centre of mass and ankle movement, to explore the potential of these methods on human-induced vibration research. Consumer-grade cameras are used without artificial markers, to take videos for further processing and wearable inertial sensors were used to validate and evaluate the computer vision measurements.

[1]  Billie F. Spencer,et al.  Vision-Based Modal Survey of Civil Infrastructure Using Unmanned Aerial Vehicles , 2019, Journal of Structural Engineering.

[2]  Myra Lydon,et al.  Development and field testing of a vision-based displacement system using a low cost wireless action camera , 2019, Mechanical Systems and Signal Processing.

[3]  Antonino Quattrone,et al.  A framework for experimental determination of localised vertical pedestrian forces on full-scale structures using wireless attitude and heading reference systems , 2016 .

[4]  Amin Heidarpour,et al.  A framework for quantification of human-structure interaction in vertical direction , 2018, Journal of Sound and Vibration.

[5]  Vitomir Racic,et al.  Acceleration response spectrum for prediction of structural vibration due to individual bouncing , 2016 .

[6]  Jing Liu,et al.  Pedestrian tracking framework based on deep convolution network and SIFT , 2018 .

[7]  James M. W. Brownjohn,et al.  A non‐contact vision‐based system for multipoint displacement monitoring in a cable‐stayed footbridge , 2018 .

[8]  Paul Reynolds,et al.  Vibration serviceability of footbridges under human-induced excitation : a literature review , 2005 .

[9]  Yozo Fujino,et al.  Image Processing for Capturing Motions of Crowd and Its Application to Pedestrian-Induced Lateral Vibration of a Footbridge , 2007 .

[10]  Md. Milon Islam,et al.  A Computer Vision based Lane Detection Approach , 2019, International Journal of Image, Graphics and Signal Processing.

[11]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  F. Horak,et al.  Role of Body-Worn Movement Monitor Technology for Balance and Gait Rehabilitation , 2014, Physical Therapy.

[13]  Chuan-Zhi Dong,et al.  A computer vision approach for the load time history estimation of lively individuals and crowds , 2018 .

[14]  William Hudson,et al.  Footbridge system identification using wireless inertial measurement units for force and response measurements , 2016 .

[15]  Jiwon Kim,et al.  Pedestrian tracking framework utilising computer vision for rapid analysis of public spaces , 2017 .

[16]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.