Design and Implementation of Intelligent Inspection and Alarm Flight System for Epidemic Prevention

Unmanned aerial vehicles (UAV) and related technologies have played an active role in the prevention and control of novel coronaviruses at home and abroad, especially in epidemic prevention, surveillance, and elimination. However, the existing UAVs have a single function, limited processing capacity, and poor interaction. To overcome these shortcomings, we designed an intelligent anti-epidemic patrol detection and warning flight system, which integrates UAV autonomous navigation, deep learning, intelligent voice, and other technologies. Based on the convolution neural network and deep learning technology, the system possesses a crowd density detection method and a face mask detection method, which can detect the position of dense crowds. Intelligent voice alarm technology was used to achieve an intelligent alarm system for abnormal situations, such as crowd-gathering areas and people without masks, and to carry out intelligent dissemination of epidemic prevention policies, which provides a powerful technical means for epidemic prevention and delaying their spread. To verify the superiority and feasibility of the system, high-precision online analysis was carried out for the crowd in the inspection area, and pedestrians’ faces were detected on the ground to identify whether they were wearing a mask. The experimental results show that the mean absolute error (MAE) of the crowd density detection was less than 8.4, and the mean average precision (mAP) of face mask detection was 61.42%. The system can provide convenient and accurate evaluation information for decision-makers and meets the requirements of real-time and accurate detection.

[1]  Li Yan,et al.  OSSIM: An Object-Based Multiview Stereo Algorithm Using SSIM Index Matching Cost , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Peng Sun,et al.  Aerial Target Tracking Algorithm Based on Faster R-CNN Combined with Frame Differencing , 2017 .

[3]  Jianxiang Xi,et al.  Limited-energy output formation for multiagent systems with intermittent interactions , 2021, J. Frankl. Inst..

[4]  He Zhang,et al.  Real-Time Top-View People Counting Based on a Kinect and NVIDIA Jetson TK1 Integrated Platform , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[5]  Yibo Ai,et al.  Mask-guided SSD for small-object detection , 2020, Applied Intelligence.

[6]  Vishal M. Patel,et al.  A Survey of Recent Advances in CNN-based Single Image Crowd Counting and Density Estimation , 2017, Pattern Recognit. Lett..

[7]  Chao Chen,et al.  Optimization of Base Location and Patrol Routes for Unmanned Aerial Vehicles in Border Intelligence, Surveillance, and Reconnaissance , 2019, Journal of Advanced Transportation.

[8]  Haibin Duan,et al.  A cascade adaboost and CNN algorithm for drogue detection in UAV autonomous aerial refueling , 2020, Neurocomputing.

[9]  Robert W. Heath,et al.  Rate Bounds on SSIM Index of Quantized Images , 2008, IEEE Transactions on Image Processing.

[10]  Alex Pappachen James,et al.  IN-YOLO: Real-Time Detection of Outdoor High Voltage Insulators Using UAV Imaging , 2020, IEEE Transactions on Power Delivery.

[11]  S. Rozelle,et al.  Epidemiology, causes, clinical manifestation and diagnosis, prevention and control of coronavirus disease (COVID-19) during the early outbreak period: a scoping review , 2020, Infectious Diseases of Poverty.

[12]  Jean Rouat,et al.  Real-Time Speech Enhancement with GCC-NMF: Demonstration on the Raspberry Pi and NVIDIA Jetson , 2017, INTERSPEECH.

[13]  Yuxuan He,et al.  Using infrared HOG-based pedestrian detection for outdoor autonomous searching UAV with embedded system , 2018, International Conference on Graphic and Image Processing.

[14]  Jiwei Fan,et al.  Infrared Small Target Detection Based on Local Hypergraph Dissimilarity Measure , 2020, IEEE Geoscience and Remote Sensing Letters.

[15]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Sparsh Mittal,et al.  A Survey on optimized implementation of deep learning models on the NVIDIA Jetson platform , 2019, J. Syst. Archit..

[17]  Ying-Chih Lai,et al.  Detection of a Moving UAV Based on Deep Learning-Based Distance Estimation , 2020, Remote. Sens..

[18]  Jianxiang Xi,et al.  Energy-Constraint Formation for Multiagent Systems With Switching Interaction Topologies , 2020, IEEE Transactions on Circuits and Systems I: Regular Papers.

[19]  Hatice Gunes,et al.  Registration-free Face-SSD: Single shot analysis of smiles, facial attributes, and affect in the wild , 2019, Comput. Vis. Image Underst..

[20]  Tinglong Tang,et al.  Robot vision application on embedded vision implementation with digital signal processor , 2020 .

[21]  F. Necati Catbas,et al.  Swaying displacement measurement for structural monitoring using computer vision and an unmanned aerial vehicle , 2020 .

[22]  Cheng Wang,et al.  Limited-Budget Output Consensus for Descriptor Multiagent Systems With Energy Constraints , 2020, IEEE Transactions on Cybernetics.

[23]  Xiang Zhou,et al.  ISSD: Improved SSD for Insulator and Spacer Online Detection Based on UAV System , 2020, Sensors.

[24]  R. Thillainayagi,et al.  Moving Target Detection Using Adaptive Background Segmentation Technique for UAV based Aerial Surveillance , 2014 .

[25]  Jiwei Fan,et al.  Robust Infrared Small Target Detection via Multidirectional Derivative-Based Weighted Contrast Measure , 2022, IEEE Geoscience and Remote Sensing Letters.

[26]  Environmental impacts on the transmission and evolution of COVID-19 combing the knowledge of pathogenic respiratory coronaviruses☆ , 2020, Environmental Pollution.

[27]  Felipe Gonzalez,et al.  Open source computer-vision based guidance system for UAVs on-board decision making , 2016, 2016 IEEE Aerospace Conference.

[28]  Kai Hu,et al.  A Marine Object Detection Algorithm Based on SSD and Feature Enhancement , 2020, Complex..

[29]  Naeem Ramzan,et al.  Human detection based on deep learning YOLO-v2 for real-time UAV applications , 2021, J. Exp. Theor. Artif. Intell..

[30]  Stjepan Bogdan,et al.  Vision-based system for a real-time detection and following of UAV , 2019, 2019 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED UAS).

[31]  Haibin Ling,et al.  SANet: Structure-Aware Network for Visual Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).