Real-time Multicopter Detection Using Pixel-level Digital Filters for Frame-Interpolated High-frame-rate Images

This study proposes a fast algorithm for vision-based vibration source localization that can detect vibration sources at hundreds of Hertz by inspecting time-varying brightness signals at each pixel in high frame rate (HFR) images. Our algorithm can significantly reduce the computational complexity of pixel-level digital filters for vibration source localization by virtually adjusting the sampling rate to twice the vibration frequency of a target object to be tracked using downsampled HFR images with frame interpolation. We confirmed that a target object vibrating at 200 Hz or less can be localized in real time with pixel-level digital filters using $\pmb{512}\times \pmb{512}$ images at 1000 fps without degrading the filter properties when our algorithm was implemented by software on a personal computer. The effectiveness of our algorithm was demonstrated by showing the experimental results for a flying multicopter with four dual-blade propellers rotating at 95 rps in an outdoor location.

[1]  Takeshi Takaki,et al.  500-fps face tracking system , 2012, Journal of Real-Time Image Processing.

[2]  Huiyu Zhou,et al.  Object tracking using SIFT features and mean shift , 2009, Comput. Vis. Image Underst..

[3]  Alejandro F. Frangi,et al.  Gaussian weak classifiers based on co-occurring Haar-like features for face detection , 2012, Pattern Analysis and Applications.

[4]  Masatoshi Ishikawa,et al.  4.9 A 1ms high-speed vision chip with 3D-stacked 140GOPS column-parallel PEs for spatio-temporal image processing , 2017, 2017 IEEE International Solid-State Circuits Conference (ISSCC).

[5]  Xudong Jiang,et al.  LBP-Based Edge-Texture Features for Object Recognition , 2014, IEEE Transactions on Image Processing.

[6]  Bing-Fei Wu,et al.  A Relative-Discriminative-Histogram-of-Oriented-Gradients-Based Particle Filter Approach to Vehicle Occlusion Handling and Tracking , 2014, IEEE Transactions on Industrial Electronics.

[7]  Hua Yang,et al.  Vibration Sensing of a Bridge Model Using a Multithread Active Vision System , 2017, IEEE/ASME Transactions on Mechatronics.

[8]  Akio Namiki,et al.  Ball catching in kendama game by estimating grasp conditions based on a high-speed vision system and tactile sensors , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[9]  Vincent Lepetit,et al.  Flying objects detection from a single moving camera , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Tadayoshi Aoyama,et al.  Real-Time Vibration Source Tracking Using High-Speed Vision , 2017, IEEE Sensors Journal.

[11]  Tadayoshi Aoyama,et al.  Simultaneous Vision-Based Shape and Motion Analysis of Cells Fast-Flowing in a Microchannel , 2015, IEEE Transactions on Automation Science and Engineering.

[12]  Peter Wellig,et al.  Detection and tracking of drones using advanced acoustic cameras , 2015, SPIE Security + Defence.

[13]  Rohit Chandra,et al.  Parallel programming in openMP , 2000 .

[14]  P. Fua,et al.  Detecting Flying Objects Using a Single Moving Camera , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Tadayoshi Aoyama,et al.  Pixel-Level and Robust Vibration Source Sensing in High-Frame-Rate Video Analysis , 2016, Sensors.

[16]  Tien Pham,et al.  TTCP AG-6: acoustic detection and tracking of UAVs , 2004, SPIE Defense + Commercial Sensing.

[17]  Fumihito Arai,et al.  Red blood cell fatigue evaluation based on the close-encountering point between extensibility and recoverability. , 2014, Lab on a chip.

[18]  Takeshi Takaki,et al.  2000 fps real-time vision system with high-frame-rate video recording , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  Hua Yang,et al.  Dynamics-Based Stereo Visual Inspection Using Multidimensional Modal Analysis , 2013, IEEE Sensors Journal.