Using YOLO-based pedestrian detection for monitoring UAV

Pedestrian detection (PD) is an important application domain in computer vision and pattern recognition. Conventional PD in real life scene is usually based on a fixed camera, which can detect and track the pedestrians in the monitoring region. However, when the pedestrian leaves the visible area of the fixed camera, it is usually difficult, if not impossible, to monitor the pedestrian. In response to the limitations of the conventional pedestrian detection application scenarios, a four-rotor unmanned aerial vehicle (UAV) system equipped with a high-definition (HD) camera is designed and implemented to detect human targets. Considering the size of human body in aerial image is small and easily to be occluded, we draw on the advanced research results in the field of target detection and propose a robust pedestrian detection method based on YOLO (You Only Look Once) network. The flow of the proposed approach is as follows. Firstly, the HD camera, which is installed on the monitoring UAV, is used for capturing images of the designated outdoor area. Secondly, image sequences are collected and processed using the airborne embedded NVIDIA Jason TX1 and Ubuntu as the core and operating system, respectively. Finally, YOLO is used to train the pedestrian classifier and perform the pedestrian detection. Experimental results show that our method has good detection results under the complicated conditions of detecting small-scale pedestrians and pedestrian occlusion.

[1]  Xu Wang,et al.  Pedestrian Detection for Transformer Substation Based on Gaussian Mixture Model and YOLO , 2016, 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[2]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[4]  Bruno Volckaert,et al.  Embedded Real-Time Object Detection for a UAV Warning System , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[5]  Yu Wang,et al.  Towards Real-Time Object Detection on Embedded Systems , 2018, IEEE Transactions on Emerging Topics in Computing.

[6]  Antonios Tsourdos,et al.  Real-time Implementation of YOLO+JPDA for Small Scale UAV Multiple Object Tracking , 2018, 2018 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[9]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  John K. Tsotsos,et al.  50 Years of object recognition: Directions forward , 2013, Comput. Vis. Image Underst..