Vehicle re-identification in tunnel scenes via synergistically cascade forests

Abstract Nowadays, numerous cameras have been equipped in tunnels for monitoring the tunnel safety, such as detecting fire, vehicle stopping, crashes, and so forth. Nevertheless, safety events in tunnels may occur in the blind zones not covered by the multi-camera monitoring systems. Therefore, this paper opens the challenging problem, tunnel vehicle re-identification (abbr. tunnel vehicle Re-ID), to make a between-camera speculation. Different from the open road scenes focused by existing vehicle Re-ID methods, tunnel vehicle Re-ID is more challenging because of poor light condition, low resolution, frequent occlusion, severe motion blur, high between-vehicle similarity, and so on. To be specific, we propose a synergistically cascade forests (SCF) model which aims to gradually construct the linking relation between vehicle samples with an increasing of alternative layers of random forest and extremely randomized forest. Through the modeling of SCF, we can restrict the influence of little inter-variation of different vehicle identities and large intra-variation of the same identities. This paper constructs a new and challenging tunnel vehicle dataset (Tunnel-VReID), consisting of 1000 pairs of tunnel vehicle images. Extensive experiments on our Tunnel-VReID demonstrate that the proposed method can outperform current state-of-the-art methods. Besides, in order to prove the adaptation ability of SCF, we also verify the superiority of SCF on a large-scale vehicle Re-ID dataset, named as VehicleID, collected in open road scenes.

[1]  Xiaogang Wang,et al.  Person Re-identification by Salience Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Arko Barman,et al.  SHaPE: A Novel Graph Theoretic Algorithm for Making Consensus-Based Decisions in Person Re-identification Systems , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[4]  Qi Wang,et al.  Bike-Person Re-Identification: A Benchmark and a Comprehensive Evaluation , 2018, IEEE Access.

[5]  Ji Feng,et al.  Deep Forest: Towards An Alternative to Deep Neural Networks , 2017, IJCAI.

[6]  Xiaogang Wang,et al.  Orientation Invariant Feature Embedding and Spatial Temporal Regularization for Vehicle Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Huibing Wang,et al.  Learning multi-region features for vehicle re-identification with context-based ranking method , 2019, Neurocomputing.

[8]  Shengcai Liao,et al.  Efficient PSD Constrained Asymmetric Metric Learning for Person Re-Identification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Aleksandra Pizurica,et al.  Split-and-match: A Bayesian framework for vehicle re-identification in road tunnels , 2015, Eng. Appl. Artif. Intell..

[10]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Vittorio Murino,et al.  Symmetry-driven accumulation of local features for human characterization and re-identification , 2013, Comput. Vis. Image Underst..

[12]  Hani S. Mahmassani,et al.  Dynamic origin-destination demand estimation using automatic vehicle identification data , 2006, IEEE Transactions on Intelligent Transportation Systems.

[13]  Yiik Diew Wong,et al.  Road traffic accidents in Singapore expressway tunnels , 2013 .

[14]  Yi Yang,et al.  A Discriminatively Learned CNN Embedding for Person Reidentification , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[15]  Qi Tian,et al.  Beyond Part Models: Person Retrieval with Refined Part Pooling , 2017, ECCV.

[16]  Yanjie Yao,et al.  Vehicle License Plate Recognition Based on Extremal Regions and Restricted Boltzmann Machines , 2016, IEEE Transactions on Intelligent Transportation Systems.

[17]  Qingming Huang,et al.  Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Xiying Li,et al.  VRID-1: A basic vehicle re-identification dataset for similar vehicles , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[19]  Di Wu,et al.  Multi-modal metric learning for vehicle re-identification in traffic surveillance environment , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[20]  Xuelong Li,et al.  Hierarchical Feature Selection for Random Projection , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Paola Zuccolotto,et al.  Variable Selection Using Random Forests , 2006 .

[22]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[23]  Yuan Yan Tang,et al.  High-Order Distance-Based Multiview Stochastic Learning in Image Classification , 2014, IEEE Transactions on Cybernetics.

[24]  Wu Liu,et al.  Large-scale vehicle re-identification in urban surveillance videos , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Ling Shao,et al.  Viewpoint-Aware Attentive Multi-view Inference for Vehicle Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Lori White,et al.  A Systematic Approach for Variable Selection With Random Forests: Achieving Stable Variable Importance Values , 2017, IEEE Geoscience and Remote Sensing Letters.

[27]  Xiaojing Chen,et al.  Multi-graph feature level fusion for person re-identification , 2017, Neurocomputing.

[28]  Stephen G. Ritchie,et al.  Freeway Corridor Performance Measurement Based on Vehicle Reidentification , 2010, IEEE Transactions on Intelligent Transportation Systems.

[29]  Qi Tian,et al.  Scalable Person Re-identification on Supervised Smoothed Manifold , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Gang Wang,et al.  Person Re-identification with Cascaded Pairwise Convolutions , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  S. Charbonnier,et al.  Vehicle re-identification with a single magnetic sensor , 2012, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[32]  Dong Liu,et al.  Improving triplet-wise training of convolutional neural network for vehicle re-identification , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[33]  Kaiqi Huang,et al.  Beyond Triplet Loss: A Deep Quadruplet Network for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Xiaogang Wang,et al.  Learning Mid-level Filters for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  David Zhang,et al.  Joint Learning of Single-Image and Cross-Image Representations for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Shiguang Shan,et al.  Self-Paced Curriculum Learning , 2015, AAAI.

[37]  Tao Mei,et al.  PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance , 2018, IEEE Transactions on Multimedia.

[38]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[39]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[40]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[41]  Larry S. Davis,et al.  Joint Learning for Attribute-Consistent Person Re-Identification , 2014, ECCV Workshops.

[42]  Ling-Yu Duan,et al.  Group-Sensitive Triplet Embedding for Vehicle Reidentification , 2018, IEEE Transactions on Multimedia.

[43]  Sheng-rui Zhang,et al.  Characteristics of traffic accidents in Chinese freeway tunnels , 2009 .

[44]  Pengfei Shi,et al.  An Algorithm for License Plate Recognition Applied to Intelligent Transportation System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[45]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[46]  Peng Wang,et al.  Person re-identification post-rank optimization via hypergraph-based learning , 2018, Neurocomputing.

[47]  Tiejun Huang,et al.  Deep Relative Distance Learning: Tell the Difference between Similar Vehicles , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Stephen G. Ritchie,et al.  Anonymous Vehicle Reidentification Using Heterogeneous Detection Systems , 2007, IEEE Transactions on Intelligent Transportation Systems.

[49]  Xiaogang Wang,et al.  Learning Deep Neural Networks for Vehicle Re-ID with Visual-spatio-Temporal Path Proposals , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[50]  Yi Yang,et al.  Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[51]  Liang Lin,et al.  Deep feature learning with relative distance comparison for person re-identification , 2015, Pattern Recognit..

[52]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[53]  Jiwen Lu,et al.  Learning Invariant Color Features for Person Reidentification , 2014, IEEE Transactions on Image Processing.

[54]  Xingzhang Ren,et al.  A Dynamic Boosted Ensemble Learning Based on Random Forest , 2018 .

[55]  Tao Mei,et al.  A Deep Learning-Based Approach to Progressive Vehicle Re-identification for Urban Surveillance , 2016, ECCV.

[56]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.