Vehicle Tracking and Monitoring in Surveillance Video

A video surveillance system has become an integral part of the smart city infrastructure. However, it still lacks its utilization to the full potential. In this work, we present a case study in which a storage center surveillance data has been used to extract useful information automatically. A surveillance camera records the movement of trucks passing through a storage center gate where a clerk registers the truck-related data. This process is prone to suffer from inaccuracy, fraud, and loss. The challenge is to automate the data entry process through video such that the warehouse achieves a seamless and errorfree record-keeping. In this paper, we present a framework to use the surveillance video to extract useful information such as detection of trucks, their registration number/ownership identification, count of incoming and outgoing trucks, and count of loaded or empty trucks. We tested the work presented in this paper at the paddy storage centers in Chhattisgarh, India, and the results were very encouraging.

[1]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Luis Miguel Bergasa,et al.  Expert video-surveillance system for real-time detection of suspicious behaviors in shopping malls , 2015, Expert Syst. Appl..

[3]  Wei Liu,et al.  DSSD : Deconvolutional Single Shot Detector , 2017, ArXiv.

[4]  Dumitru Erhan,et al.  Scalable Object Detection Using Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  R. Smith,et al.  An Overview of the Tesseract OCR Engine , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[6]  Ramakant Nevatia,et al.  Learning to associate: HybridBoosted multi-target tracker for crowded scene , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Ling Chen,et al.  Automatic key frame extraction in continuous videos from construction monitoring by using color, texture, and gradient features , 2017 .

[9]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[10]  R. Nedunchezhian,et al.  A study on video data mining , 2012, International Journal of Multimedia Information Retrieval.

[11]  Ling Shao,et al.  Video Salient Object Detection via Fully Convolutional Networks , 2017, IEEE Transactions on Image Processing.

[12]  Bohyung Han,et al.  Multi-object Tracking with Quadruplet Convolutional Neural Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Ajay Kumar Singh,et al.  ANPR Indian system using surveillance cameras , 2015, 2015 Eighth International Conference on Contemporary Computing (IC3).

[14]  Yohan Dupuis,et al.  A Survey of Vision-Based Traffic Monitoring of Road Intersections , 2016, IEEE Transactions on Intelligent Transportation Systems.

[15]  Christof Röhrig,et al.  Tracking of transport vehicles for warehouse management using a wireless sensor network , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Dietrich Paulus,et al.  Simple online and realtime tracking with a deep association metric , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[17]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[18]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[19]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Francesco Solera,et al.  Performance Measures and a Data Set for Multi-target, Multi-camera Tracking , 2016, ECCV Workshops.

[21]  Ezzeddine Zagrouba,et al.  Abnormal behavior recognition for intelligent video surveillance systems: A review , 2018, Expert Syst. Appl..

[22]  Joel J. P. C. Rodrigues,et al.  Fog-Based Crime-Assistance in Smart IoT Transportation System , 2018, IEEE Access.

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Anouar Ben Khalifa,et al.  Event detection in video sequences: Challenges and perspectives , 2017, 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).