Edge-based street object detection

Nowadays everything is becoming smart and intelligent with the help of Internet of Things (IoT) and artificial intelligence (AI). One of the promising applications of the integration of IoT and AI is smart city. The typical design pattern of smart cities is to install cameras and various sensors as many spots as possible and connect them to data center servers that can make smart decisions based on the inputs from the cameras and sensors. In such structure, network bandwidth may hinder the real-time processing because sensory data should be sent to the servers in the remote location before making any decision. To solve this problem, recent a few studies demonstrated edge computing. In edge computing, IoT devices can handle basic recognition. Thus, only sophisticated inputs that are not handled by IoT devices are sent to remote servers. In this paper, we demonstrate that the edge computing can provide stand-alone processing power for handling one of the fundamental applications of smart city, which is street object detection. Correct detection of various street objects is the core function of traffic systems and public safety applications of smart cities. A convolutional neural network model is developed by training with traffic data captured at California and Nebraska. Our model detects 14 objects with 25% average accuracy on NVIDIA Jetson TX2.

[1]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[2]  David C. Anastasiu,et al.  The NVIDIA AI City Challenge , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.