Regional Detection of Traffic Congestion Using in a Large-Scale Surveillance System via Deep Residual TrafficNet

Despite the huge amount of traffic surveillance videos and images have been accumulated in the daily monitoring, deep learning approaches have been underutilized in the application of traffic intelligent management and control. In this paper, traffic images, including various illumination, weather conditions, and vast scenarios, are extracted from the current surveillance system using in Shaanxi Province and preprocessed to set up a proper training dataset. In order to detect traffic congestion, a network structure is proposed based on residual learning to be pre-trained and fine-tuned. The network is then transferred to the traffic application and re-trained with self-established training dataset to generate the TrafficNet. The accuracy of TrafficNet to classify congested and uncongested road states reaches 99% for the validation dataset and 95% for the testing dataset. The proposed TrafficNet are verified by a regional detection of traffic congestion on a large-scale surveillance system currently using in China. The effectiveness and efficiencies are magnificently demonstrated with quick detection in the high accuracy in the case study. The experimental trial could extend its successful application to traffic surveillance system and has potential enhancement for intelligent transport system in future.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Ngai-Man Cheung,et al.  Image-based vehicle analysis using deep neural network: A systematic study , 2016, 2016 IEEE International Conference on Digital Signal Processing (DSP).

[3]  Li Li,et al.  Detection of unwanted traffic congestion based on existing surveillance system using in freeway via a CNN-architecture trafficnet , 2018, 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[4]  Xiaoou Tang,et al.  A large-scale car dataset for fine-grained categorization and verification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  LinLin Shen,et al.  Deep cross residual network for HEp-2 cell staining pattern classification , 2018, Pattern Recognit..

[6]  Hassan Ghassemian,et al.  A probabilistic SVM approach for hyperspectral image classification using spectral and texture features , 2017 .

[7]  Kunihiko Fukushima,et al.  Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition , 1982 .

[8]  Ye Sun,et al.  Vehicle Logo Recognition System Based on Convolutional Neural Networks With a Pretraining Strategy , 2015, IEEE Transactions on Intelligent Transportation Systems.

[9]  Peter C. Y. Chen,et al.  LSTM network: a deep learning approach for short-term traffic forecast , 2017 .

[10]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[11]  Feng Zhou,et al.  A deeply supervised residual network for HEp-2 cell classification via cross-modal transfer learning , 2018, Pattern Recognit..

[12]  Yasser M. Kadah,et al.  An Automatic Computer-Aided Diagnosis System for Breast Cancer in Digital Mammograms via Deep Belief Network , 2018 .

[13]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[15]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[16]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Teresa Pamula,et al.  Road Traffic Conditions Classification Based on Multilevel Filtering of Image Content Using Convolutional Neural Networks , 2018, IEEE Intelligent Transportation Systems Magazine.

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[20]  Louahdi Khoudour,et al.  Exploiting deep residual networks for human action recognition from skeletal data , 2018, Comput. Vis. Image Underst..

[21]  Fei-Yue Wang,et al.  Traffic Flow Prediction With Big Data: A Deep Learning Approach , 2015, IEEE Transactions on Intelligent Transportation Systems.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Huchuan Lu,et al.  Deep visual tracking: Review and experimental comparison , 2018, Pattern Recognit..

[24]  Jianglei Di,et al.  Deep learning-based object classification through multimode fiber via a CNN-architecture SpeckleNet. , 2018, Applied optics.

[25]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[26]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[27]  Wenxian Yu,et al.  A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection From SAR Images , 2018, IEEE Access.

[28]  Yunde Jia,et al.  Vehicle Type Classification Using a Semisupervised Convolutional Neural Network , 2015, IEEE Transactions on Intelligent Transportation Systems.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.