Automatic Detection of Parking Violation and Capture of License Plate

Illegal parking is a ubiquitous problem faced by urban cities, posing potential traffic impediments and safety risks to other road users. Surveillance video captured is stored for post-event forensics and often requires manual inspection to detect the violating vehicles. Automated detection techniques include foreground and background segmentation which is less robust to environmental factors as well as the more robust Single Shot MultiBox Detector (SSD) and its variants. This paper proposes a fully automated pipeline to perform end-to-end illegal parking detection. Robust and fast vehicle detection is achieved using a deep learning-based object detection algorithm, You Only Look Once Version 3 (YOLOv3). Movement tracking uses template matching and Intersection over Union (IoU) calculations to track the stationary time of the vehicle-in-violation with built-in mechanisms for error tolerance. OpenALPR is used for extraction of the license plate. Empirical results show a high accuracy of vehicle detection and movement tracking under varying environmental conditions and very good performance in license plate capture.

[1]  Chai Kiat Yeo,et al.  Unauthorized Parking Detection using Deep Networks at Real Time , 2019, 2019 IEEE International Conference on Smart Computing (SMARTCOMP).

[2]  Jake K. Aggarwal,et al.  Real-Time Illegal Parking Detection in Outdoor Environments Using 1-D Transformation , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Antonio Albiol,et al.  Detection of Parked Vehicles Using Spatiotemporal Maps , 2011, IEEE Transactions on Intelligent Transportation Systems.

[4]  Kang-Hyun Jo,et al.  Illegally parked vehicle detection using adaptive dual background model , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[5]  Ma Xing,et al.  Smart Detection of Vehicle in Illegal Parking Area by Fusing of Multi-features , 2015, 2015 9th International Conference on Next Generation Mobile Applications, Services and Technologies.

[6]  Larry S. Davis,et al.  Multiple vehicle detection and tracking in hard real-time , 1996, Proceedings of Conference on Intelligent Vehicles.

[7]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[8]  Osama Masoud,et al.  Vision-based vehicle classification , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[9]  Massimo Bertozzi,et al.  Stereo vision-based vehicle detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[10]  Guangming Shi,et al.  Real-Time Illegal Parking Detection System Based on Deep Learning , 2017, ICDLT '17.

[11]  Pallavi Choudekar,et al.  Real time car parking system using image processing , 2011, 2011 3rd International Conference on Electronics Computer Technology.

[12]  Changsheng Xu,et al.  Mining Semantic Context Information for Intelligent Video Surveillance of Traffic Scenes , 2013, IEEE Transactions on Industrial Informatics.

[13]  Andrea Cavallaro,et al.  Video Analytics for Surveillance: Theory and Practice [From the Guest Editors] , 2010 .

[14]  Jitendra Malik,et al.  Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[16]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[17]  Kang-Hyun Jo,et al.  Cumulative Dual Foreground Differences for Illegally Parked Vehicles Detection , 2017, IEEE Transactions on Industrial Informatics.