Large-scale vehicle trajectory reconstruction with camera sensing network

Vehicle trajectories provide essential information to understand the urban mobility and benefit a wide range of urban applications. State-of-the-art solutions for vehicle sensing may not build accurate and complete knowledge of all vehicle trajectories. In order to fill the gap, this paper proposes VeTrac, a comprehensive system that employs widely deployed traffic cameras as a sensing network to trace vehicle movements and reconstruct their trajectories in a large scale. VeTrac fuses mobility correlation and vision-based analysis to reduce uncertainties in identifying vehicles. A graph convolution process is employed to maintain the identity consistency across different camera observations, and a self-training process is invoked when aligning with the urban road network to reconstruct vehicle trajectories with confidence. Extensive experiments with real-world data input of over 7 million vehicle snapshots from over one thousand traffic cameras demonstrate that VeTrac achieves 98% accuracy for simple expressway scenario and 89% accuracy for complex urban environment. The achieved accuracy outperforms alternative solutions by 32% for expressway scenario and by 59% for complex urban environment.

[1]  Qiang Gao,et al.  Trajectory-based social circle inference , 2018, SIGSPATIAL/GIS.

[2]  Yang Wang,et al.  VeMo: Enabling Transparent Vehicular Mobility Modeling at Individual Levels with Full Penetration , 2018, MobiCom.

[3]  Xiaogang Wang,et al.  Orientation Invariant Feature Embedding and Spatial Temporal Regularization for Vehicle Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Bing He,et al.  Part-Regularized Near-Duplicate Vehicle Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Yan Wang,et al.  Your Phone Tells Us The Truth: Driver Identification Using Smartphone on One Turn , 2018, MobiCom.

[6]  Aakanksha Chowdhery,et al.  The Design and Implementation of a Wireless Video Surveillance System , 2015, MobiCom.

[7]  Romit Roy Choudhury,et al.  Closing the Gaps in Inertial Motion Tracking , 2018, MobiCom.

[8]  Jingyuan Wang,et al.  Deep Trajectory Recovery with Fine-Grained Calibration using Kalman Filter , 2019, IEEE Transactions on Knowledge and Data Engineering.

[9]  Xiang Bai,et al.  An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  John Krumm,et al.  Hidden Markov map matching through noise and sparseness , 2009, GIS.

[11]  Xing Xie,et al.  Reducing Uncertainty of Low-Sampling-Rate Trajectories , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[12]  Hui Xiong,et al.  Discovering Urban Functional Zones Using Latent Activity Trajectories , 2015, IEEE Transactions on Knowledge and Data Engineering.

[13]  Sofiane Abbar,et al.  RoadRunner: improving the precision of road network inference from GPS trajectories , 2018, SIGSPATIAL/GIS.

[14]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[15]  Tao Mei,et al.  PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance , 2018, IEEE Transactions on Multimedia.

[16]  Mo Li,et al.  Last-Mile School Shuttle Planning With Crowdsensed Student Trajectories , 2021, IEEE Transactions on Intelligent Transportation Systems.

[17]  Sriram Raghavan,et al.  Inferring Uncertain Trajectories from Partial Observations , 2014, 2014 IEEE International Conference on Data Mining.

[18]  Piotr Indyk,et al.  Faster GPS via the sparse fourier transform , 2012, Mobicom '12.

[19]  Dongming Lu,et al.  Mining Road Network Correlation for Traffic Estimation via Compressive Sensing , 2016, IEEE Transactions on Intelligent Transportation Systems.

[20]  Ling-Yu Duan,et al.  Group-Sensitive Triplet Embedding for Vehicle Reidentification , 2018, IEEE Transactions on Multimedia.

[21]  Xiaoying Gan,et al.  VDNet: an infrastructure-less UAV-assisted sparse VANET system with vehicle location prediction , 2016, Wirel. Commun. Mob. Comput..

[22]  Jiliang Wang,et al.  RainbowLight: Towards Low Cost Ambient Light Positioning with Mobile Phones , 2018, MobiCom.

[23]  Marco Gruteser,et al.  ParkNet: drive-by sensing of road-side parking statistics , 2010, MobiSys '10.

[24]  Ricardo J. G. B. Campello,et al.  Density-Based Clustering Based on Hierarchical Density Estimates , 2013, PAKDD.

[25]  Yang Wang,et al.  Experience: Understanding Long-Term Evolving Patterns of Shared Electric Vehicle Networks , 2018, MobiCom.

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  Suman Banerjee,et al.  A vehicle-based edge computing platform for transit and human mobility analytics , 2017, SEC.

[28]  Tao Mei,et al.  A Deep Learning-Based Approach to Progressive Vehicle Re-identification for Urban Surveillance , 2016, ECCV.

[29]  Supun Samarasekera,et al.  Vehicle tracking across nonoverlapping cameras using joint kinematic and appearance features , 2011, CVPR 2011.

[30]  Fan Zhang,et al.  coRide: carpool service with a win-win fare model for large-scale taxicab networks , 2013, SenSys '13.

[31]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[32]  Jie Yang,et al.  Push the limit of WiFi based localization for smartphones , 2012, Mobicom '12.

[33]  Mo Li,et al.  How Long to Wait? Predicting Bus Arrival Time With Mobile Phone Based Participatory Sensing , 2012, IEEE Transactions on Mobile Computing.

[34]  Xiaoying Gan,et al.  Crowdsensing-Based Consensus Incident Report for Road Traffic Acquisition , 2018, IEEE Transactions on Intelligent Transportation Systems.

[35]  Alexander J. Smola,et al.  Inferring Movement Trajectories from GPS Snippets , 2015, WSDM.

[36]  Maan El Badaoui El Najjar,et al.  A Road-Matching Method for Precise Vehicle Localization Using Belief Theory and Kalman Filtering , 2005, Auton. Robots.

[37]  Yu Zheng,et al.  Travel time estimation of a path using sparse trajectories , 2014, KDD.

[38]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[39]  Heikki Mannila,et al.  Random projection in dimensionality reduction: applications to image and text data , 2001, KDD '01.

[40]  Paramvir Bahl,et al.  Panoptes: Servicing Multiple Applications Simultaneously Using Steerable Cameras , 2017, 2017 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).