A Deep Pedestrian Tracking SSD-Based Model in the Sudden Emergency or Violent Environment

Public security monitoring is a hot issue that the government and citizens pay close attention to. Multiobject tracking plays an important role in solving many problems for public security. Under crowded scenarios and emergency places, it is a challenging problem to predict and warn owing to the complexity of crowd intersection. There are still many deficiencies in the research of multiobject trajectory prediction, which mostly employ object detection and data association. Compared with the tremendous progress in object detection, data association still relied on hand-crafted constraints such as group, motion, and spatial proximity. Emergencies usually have the characteristics of mutation, target diversification, low illumination, or resolution, which makes multitarget tracking more difficult. In this paper, we harness the advance of the deep learning framework for data association in object tracking by jointly modeling pedestrian features. The proposed deep pedestrian tracking SSD-based model can pair and link pedestrian features in any two frames. The model was trained with open dataset, and the results, accuracy, and speed of the model were compared between normal and emergency or violent environment. The experimental results show that the tracking accuracy of mAP is higher than 95% both in normal and abnormal data sets and higher than that of the traditional detection algorithm. The detection speed of the normal data set is slightly higher than that of the abnormal data set. In general, the model has good tracking results and credibility for multitarget tracking in emergency environment. The research provides technical support for safety assurance and behavior monitoring in emergency environment.

[1]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[3]  Wei Sun,et al.  Moving Vehicle Detection and Tracking Based on Optical Flow Method and Immune Particle Filter under Complex Transportation Environments , 2020, Complex..

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Dietrich Paulus,et al.  Simple online and realtime tracking with a deep association metric , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[7]  Zhaosheng Yang,et al.  Research on multi-objective decision model based on location-allocation analysis during emergency traffic evacuation , 2010, 2010 IEEE International Conference on Emergency Management and Management Sciences.

[8]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[9]  Huafeng Wu,et al.  Robust Ship Tracking via Multi-view Learning and Sparse Representation , 2018, Journal of Navigation.

[10]  Arif Merchant,et al.  Reliability of nand-Based SSDs: What Field Studies Tell Us , 2017, Proceedings of the IEEE.

[11]  Shervin Minaee,et al.  Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework , 2021, IEEE transactions on intelligent transportation systems (Print).

[12]  Oleksii Maksymiv,et al.  Deep convolutional network for detecting probable emergency situations , 2016, 2016 IEEE First International Conference on Data Stream Mining & Processing (DSMP).

[13]  Yuning Jiang,et al.  Repulsion Loss: Detecting Pedestrians in a Crowd , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Md. Sakif Rahman,et al.  Emergency Vehicle Detection on Heavy Traffic Road from CCTV Footage Using Deep Convolutional Neural Network , 2019, 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE).

[15]  Canyong Wang,et al.  Research and Application of Traffic Sign Detection and Recognition Based on Deep Learning , 2018, 2018 International Conference on Robots & Intelligent System (ICRIS).

[16]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[17]  Dimitris N. Metaxas,et al.  ASSD: Attentive Single Shot Multibox Detector , 2019, Comput. Vis. Image Underst..

[18]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[20]  Fuqiang Zhou,et al.  FSSD: Feature Fusion Single Shot Multibox Detector , 2017, ArXiv.

[21]  Yi Yang,et al.  DenseBox: Unifying Landmark Localization with End to End Object Detection , 2015, ArXiv.

[22]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Janis Grabis,et al.  Near Real-Time Big-Data Processing for Data Driven Applications , 2017, 2017 International Conference on Big Data Innovations and Applications (Innovate-Data).

[24]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  Meiyan He Study on emergency management of traffic jam and improvement of emergency mechanism during ice disaster in Hunan , 2010, 2010 IEEE International Conference on Emergency Management and Management Sciences.

[27]  De Xu,et al.  Face Detection With Different Scales Based on Faster R-CNN , 2019, IEEE Transactions on Cybernetics.

[28]  Wei Chen,et al.  Real-time Detection of Vehicle and Traffic Light for Intelligent and Connected Vehicles Based on YOLOv3 Network , 2019, 2019 5th International Conference on Transportation Information and Safety (ICTIS).

[29]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Yuning Jiang,et al.  UnitBox: An Advanced Object Detection Network , 2016, ACM Multimedia.

[31]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[32]  Shifeng Zhang,et al.  Occlusion-aware R-CNN: Detecting Pedestrians in a Crowd , 2018, ECCV.

[33]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Chuanmei Wang,et al.  Structural analysis of factors affecting urban traffic safety , 2010, 2010 International Conference on Mechanic Automation and Control Engineering.

[35]  Qiang Luo,et al.  Video-Based Detection Infrastructure Enhancement for Automated Ship Recognition and Behavior Analysis , 2020, Journal of Advanced Transportation.

[36]  Wei Liu,et al.  DSSD : Deconvolutional Single Shot Detector , 2017, ArXiv.

[37]  Wangtu Xu,et al.  Pedestrian evacuation within limited-space buildings based on different exit design schemes , 2020 .