A Smart, Efficient, and Reliable Parking Surveillance System With Edge Artificial Intelligence on IoT Devices

Cloud computing has been a main-stream computing service for years. Recently, with the rapid development in urbanization, massive video surveillance data are produced at an unprecedented speed. A traditional solution to deal with the big data would require a large amount of computing and storage resources. With the advances in Internet of things (IoT), artificial intelligence, and communication technologies, edge computing offers a new solution to the problem by processing all or part of the data locally at the edge of a surveillance system. In this study, we investigate the feasibility of using edge computing for smart parking surveillance tasks, specifically, parking occupancy detection using the real-time video feed. The system processing pipeline is carefully designed with the consideration of flexibility, online surveillance, data transmission, detection accuracy, and system reliability. It enables artificial intelligence at the edge by implementing an enhanced single shot multibox detector (SSD). A few more algorithms are developed either locally at the edge of the system or on the centralized data server targeting optimal system efficiency and accuracy. Thorough field tests were conducted in the Angle Lake parking garage for three months. The experimental results are promising that the final detection method achieves over 95% accuracy in real-world scenarios with high efficiency and reliability. The proposed smart parking surveillance system is a critical component of smart cities and can be a solid foundation for future applications in intelligent transportation systems.

[1]  Jinjun Tang,et al.  Real-Time Traffic Flow Parameter Estimation From UAV Video Based on Ensemble Classifier and Optical Flow , 2019, IEEE Transactions on Intelligent Transportation Systems.

[2]  Liangliang Lou,et al.  An Improved Roadside Parking Space Occupancy Detection Method Based on Magnetic Sensors and Wireless Signal Strength , 2019, Sensors.

[3]  Qi Luo,et al.  A Statistical Method for Parking Spaces Occupancy Detection via Automotive Radars , 2016, 2017 IEEE 85th Vehicular Technology Conference (VTC Spring).

[4]  Weiyao Lin,et al.  Tiny-DSOD: Lightweight Object Detection for Resource-Restricted Usages , 2018, BMVC.

[5]  Joonki Paik,et al.  Robust parking occupancy monitoring system using random forests , 2018, 2018 International Conference on Electronics, Information, and Communication (ICEIC).

[6]  Álvaro García-Martín,et al.  Automatic Vacant Parking Places Management System Using Multicamera Vehicle Detection , 2019, IEEE Transactions on Intelligent Transportation Systems.

[7]  Claudio Gennaro,et al.  Car parking occupancy detection using smart camera networks and Deep Learning , 2016, 2016 IEEE Symposium on Computers and Communication (ISCC).

[8]  Carlo Meghini,et al.  Deep learning for decentralized parking lot occupancy detection , 2017, Expert Syst. Appl..

[9]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[10]  Yong-Sung Jeon,et al.  Design of an LPWAN communication module based on secure element for smart parking application , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[11]  Monika Sester,et al.  Data-Driven Approaches for Smart Parking , 2017, ECML/PKDD.

[12]  Roger Zimmermann,et al.  Dynamic Urban Surveillance Video Stream Processing Using Fog Computing , 2016, 2016 IEEE Second International Conference on Multimedia Big Data (BigMM).

[13]  Vana Kalogeraki,et al.  ParkForU: A Dynamic Parking-Matching and Price-Regulator Crowdsourcing Algorithm for Mobile Applications , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[14]  Orhan Bulan,et al.  Video-based real-time on-street parking occupancy detection system , 2013, J. Electronic Imaging.

[15]  Erik Blasch,et al.  Enabling Smart Urban Surveillance at The Edge , 2017, 2017 IEEE International Conference on Smart Cloud (SmartCloud).

[16]  Stanislav Vítek,et al.  A Distributed Wireless Camera System for the Management of Parking Spaces , 2017, Sensors.

[17]  Yonghua Xiong,et al.  Design and Implementation of a Prototype Cloud Video Surveillance System , 2014, J. Adv. Comput. Intell. Intell. Informatics.

[18]  Fadi Al-Turjman,et al.  Smart parking in IoT-enabled cities: A survey , 2019, Sustainable Cities and Society.

[19]  O Casas,et al.  Wireless Magnetic Sensor Node for Vehicle Detection With Optical Wake-Up , 2011, IEEE Sensors Journal.

[20]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[21]  Khalid Elgazzar,et al.  Intelligent drone-based surveillance: application to parking lot monitoring and detection , 2019, Defense + Commercial Sensing.

[22]  Marco Tagliasacchi,et al.  A visual sensor network for parking lot occupancy detection in Smart Cities , 2015, 2015 IEEE 2nd World Forum on Internet of Things (WF-IoT).

[23]  Yi Zhang,et al.  Tube-Based Discrete Controller Design for Vehicle Platoons Subject to Disturbances and Saturation Constraints , 2020, IEEE Transactions on Control Systems Technology.

[24]  Hervé Rivano,et al.  A Survey of Smart Parking Solutions , 2017, IEEE Transactions on Intelligent Transportation Systems.

[25]  Ziyuan Pu,et al.  Roadway surveillance video camera calibration using standard shipping container , 2017, 2017 International Smart Cities Conference (ISC2).

[26]  Jun-Wei Hsieh,et al.  Drone-Based Vacant Parking Space Detection , 2018, 2018 32nd International Conference on Advanced Information Networking and Applications Workshops (WAINA).

[27]  Zhiyong Cui,et al.  Real-Time Bidirectional Traffic Flow Parameter Estimation From Aerial Videos , 2017, IEEE Transactions on Intelligent Transportation Systems.

[28]  Sergio Di Martino,et al.  How many probe vehicles do we need to collect on-street parking information? , 2017, 2017 5th IEEE International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS).

[29]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[30]  Zhiming Luo,et al.  MIO-TCD: A New Benchmark Dataset for Vehicle Classification and Localization , 2018, IEEE Transactions on Image Processing.

[31]  Ping Lu,et al.  Kill two birds with one stone: Boosting both object detection accuracy and speed with adaptive patch-of-interest composition , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[32]  Stefan Lüke,et al.  On-vehicle video-based parking lot recognition with fisheye optics , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[33]  Antonio Origlia,et al.  Smart Parking: Using a Crowd of Taxis to Sense On-Street Parking Space Availability , 2020, IEEE Transactions on Intelligent Transportation Systems.

[34]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[35]  Fengqi Yu,et al.  A Street Parking System Using Wireless Sensor Networks , 2013, Int. J. Distributed Sens. Networks.

[36]  Yu Chen,et al.  Smart Surveillance as an Edge Network Service: From Harr-Cascade, SVM to a Lightweight CNN , 2018, 2018 IEEE 4th International Conference on Collaboration and Internet Computing (CIC).

[37]  Danda B. Rawat,et al.  Smart parking: Parking occupancy monitoring and visualization system for smart cities , 2016, SoutheastCon 2016.

[38]  Dietrich Paulus,et al.  Simple online and realtime tracking with a deep association metric , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[39]  Huaqiang Yuan,et al.  A Parking Occupancy Detection Algorithm Based on AMR Sensor , 2015, IEEE Sensors Journal.

[40]  Fengqi Yu,et al.  A Vehicle Parking Detection Method Based on Correlation of Magnetic Signals , 2015, Int. J. Distributed Sens. Networks.

[41]  Zhiyong Cui,et al.  Digital roadway interactive visualization and evaluation network applications to WSDOT operational data usage. , 2016 .

[42]  Qi Wu,et al.  Robust Parking Space Detection Considering Inter-Space Correlation , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[43]  Hisashi Satonaka,et al.  DEVELOPMENT OF PARKING SPACE DETECTION USING AN ULTRASONIC SENSOR , 2006 .

[44]  Byung-Sung Kim,et al.  Parking space detection using ultrasonic sensor in parking assistance system , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[45]  Marco Gruteser,et al.  ParkNet: drive-by sensing of road-side parking statistics , 2010, MobiSys '10.

[46]  Amitabha Ghosh,et al.  Intelligent parking lot application using wireless sensor networks , 2008, 2008 International Symposium on Collaborative Technologies and Systems.

[47]  Bob Zhang,et al.  Background modeling methods in video analysis: A review and comparative evaluation , 2016, CAAI Trans. Intell. Technol..

[48]  Sergiu Nedevschi,et al.  Multimodal sparse LIDAR object tracking in clutter , 2018, 2018 IEEE 14th International Conference on Intelligent Computer Communication and Processing (ICCP).

[49]  Davide Moroni,et al.  Real-Time Smart Parking Systems Integration in Distributed ITS for Smart Cities , 2018, Journal of Advanced Transportation.

[50]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[51]  Giovanni Pau,et al.  Parkmaster: an in-vehicle, edge-based video analytics service for detecting open parking spaces in urban environments , 2017, SEC.

[52]  Herlan Herlan,et al.  Parking Slot Identification using Local Binary Pattern and Support Vector Machine , 2018, 2018 International Conference on Computer, Control, Informatics and its Applications (IC3INA).

[53]  Sang-Woong Lee,et al.  Generalized Parking Occupancy Analysis Based on Dilated Convolutional Neural Network † , 2019, Sensors.

[54]  Yinhai Wang,et al.  A Cost-Effective Framework for Automated Vehicle-Pedestrian Near-Miss Detection Through Onboard Monocular Vision , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[55]  Jie Sheng,et al.  Identifying parking spaces & detecting occupancy using vision-based IoT devices , 2017, 2017 Global Internet of Things Summit (GIoTS).