High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos

In recent years, unmanned aerial vehicle (UAV) has become an increasingly popular tool for traffic monitoring and data collection on highways due to its advantage of low cost, high resolution, good flexibility, and wide spatial coverage. Extracting high-resolution vehicle trajectory data from aerial videos taken by a UAV flying over target highway segment becomes a critical research task for traffic flow modeling and analysis. This study aims at proposing a novel methodological framework for automatic and accurate vehicle trajectory extraction from aerial videos. The method starts by developing an ensemble detector to detect vehicles in the target region. Then, the kernelized correlation filter is applied to track vehicles fast and accurately. After that, a mapping algorithm is proposed to transform vehicle positions from the Cartesian coordinates in image to the Frenet coordinates to extract raw vehicle trajectories along the roadway curves. The data denoising is then performed using a wavelet transform to eliminate the biased vehicle trajectory positions. Our method is tested on two aerial videos taken on different urban expressway segments in both peak and non-peak hours on weekdays. The extracted vehicle trajectories are compared with manual calibrated data to testify the framework performance. The experimental results show that the proposed method successfully extracts vehicle trajectories with a high accuracy: the measurement error of Mean Squared Deviation is 2.301 m, the Root-mean-square deviation is 0.175 m, and the Pearson correlation coefficient is 0.999. The video and trajectory data in this study are publicly accessible for serving as benchmark at https://seutraffic.com.

[1]  Benjamin Coifman,et al.  An Overview of Empirical Flow-Density and Speed-Spacing Relationships: Evidence of Vehicle Length Dependency , 2015 .

[2]  Jinjun Tang,et al.  Real-Time Traffic Flow Parameter Estimation From UAV Video Based on Ensemble Classifier and Optical Flow , 2019, IEEE Transactions on Intelligent Transportation Systems.

[3]  Q. Henry Wu,et al.  Identification of Power Disturbances Using Generalized Morphological Open-Closing and Close-Opening Undecimated Wavelet , 2016, IEEE Transactions on Industrial Electronics.

[4]  David Beymer,et al.  A real-time computer vision system for vehicle tracking and traffic surveillance , 1998 .

[5]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Cheolkon Jung,et al.  Fully Convolutional Siamese Fusion Networks for Object Tracking , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[7]  Benjamin Coifman,et al.  A critical evaluation of the Next Generation Simulation (NGSIM) vehicle trajectory dataset , 2017 .

[8]  Hwasoo Yeo,et al.  A Study on the Traffic Predictive Cruise Control Strategy With Downstream Traffic Information , 2016, IEEE Transactions on Intelligent Transportation Systems.

[9]  Robert M. Gray,et al.  Toeplitz and Circulant Matrices: A Review , 2005, Found. Trends Commun. Inf. Theory.

[10]  Eleni I. Vlahogianni,et al.  Unmanned Aerial Aircraft Systems for Transportation Engineering: Current Practice and Future Challenges , 2016 .

[11]  Chao Li,et al.  Risk perception and the warning strategy based on microscopic driving state. , 2018, Accident; analysis and prevention.

[12]  Farid Melgani,et al.  Automatic Car Counting Method for Unmanned Aerial Vehicle Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Zu Whan Kim,et al.  High-quality vehicle trajectory generation from video data based on vehicle detection and description , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[14]  Huafeng Wu,et al.  Robust Ship Tracking via Multi-view Learning and Sparse Representation , 2018, Journal of Navigation.

[15]  Zhiyong Cui,et al.  Real-Time Bidirectional Traffic Flow Parameter Estimation From Aerial Videos , 2017, IEEE Transactions on Intelligent Transportation Systems.

[16]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[17]  Moshe Ben-Akiva,et al.  Automatic Vehicle Trajectory Extraction by Aerial Remote Sensing , 2014 .

[18]  Mohan M. Trivedi,et al.  Understanding vehicular traffic behavior from video: a survey of unsupervised approaches , 2013, J. Electronic Imaging.

[19]  Robert M. Gray,et al.  Toeplitz And Circulant Matrices: A Review (Foundations and Trends(R) in Communications and Information Theory) , 2006 .

[20]  Giuseppe Guido,et al.  Evaluating the Accuracy of Vehicle Tracking Data Obtained from Unmanned Aerial Vehicles , 2016 .

[21]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Robert A. Schowengerdt,et al.  Airborne video registration and traffic-flow parameter estimation , 2005, IEEE Transactions on Intelligent Transportation Systems.

[23]  Julius Ziegler,et al.  Optimal trajectories for time-critical street scenarios using discretized terminal manifolds , 2012, Int. J. Robotics Res..

[24]  Xiangjian He,et al.  Robust visual tracking via efficient manifold ranking with low-dimensional compressive features , 2015, Pattern Recognit..

[25]  Marcello Montanino,et al.  Trajectory data reconstruction and simulation-based validation against macroscopic traffic patterns , 2015 .

[26]  Lorenzo Torresani,et al.  Simple , efficient and effective keypoint tracking , 2017 .

[27]  Jun-Wei Lu,et al.  Detecting Small Target of Ship at Sea by Infrared Image , 2006, 2006 IEEE International Conference on Automation Science and Engineering.

[28]  Lingna Hu,et al.  Background Suppression Based on Improved Top-Hat and Saliency Map Filtering for Infrared Ship Detection , 2017, 2017 International Conference on Computing Intelligence and Information System (CIIS).

[29]  B. P. Salmon,et al.  Synthetic Aperture Radar Ship Detection Using Haar-Like Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[30]  Fang Wang,et al.  The drivers' lane selection model based on mixed fuzzy many-person multi-objective non-cooperative game , 2017, J. Intell. Fuzzy Syst..

[31]  Xiaoru Yuan,et al.  Visual Traffic Jam Analysis Based on Trajectory Data , 2013, IEEE Transactions on Visualization and Computer Graphics.

[32]  Q. M. Jonathan Wu,et al.  Automatic Detection of Ship Targets Based on Wavelet Transform for HF Surface Wavelet Radar , 2017, IEEE Geoscience and Remote Sensing Letters.

[33]  Alexandros Sopasakis,et al.  Information metrics for improved traffic model fidelity through sensitivity analysis and data assimilation , 2016 .

[34]  Marcello Montanino,et al.  Can Results of car-following Model Calibration Based on Trajectory Data be Trusted? , 2012 .

[35]  Vassili Alexiadis,et al.  Video -Based Vehicle Trajectory Data Collection , 2007 .

[36]  Yang Li,et al.  Reliable Patch Trackers: Robust visual tracking by exploiting reliable patches , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Ruey Long Cheu,et al.  A binary decision model for discretionary lane changing move based on fuzzy inference system , 2016 .

[38]  Romain Billot,et al.  Calibration, Estimation, and Sampling Issues of Car-Following Parameters , 2014 .