Real-Time Bidirectional Traffic Flow Parameter Estimation From Aerial Videos

Unmanned aerial vehicles (UAVs) are gaining popularity in traffic monitoring due to their low cost, high flexibility, and wide view range. Traffic flow parameters such as speed, density, and volume extracted from UAV-based traffic videos are critical for traffic state estimation and traffic control and have recently received much attention from researchers. However, different from stationary surveillance videos, the camera platforms move with UAVs, and the background motion in aerial videos makes it very challenging to process for data extraction. To address this problem, a novel framework for real-time traffic flow parameter estimation from aerial videos is proposed. The proposed system identifies the directions of traffic streams and extracts traffic flow parameters of each traffic stream separately. Our method incorporates four steps that make use of the Kanade–Lucas–Tomasi (KLT) tracker, k-means clustering, connected graphs, and traffic flow theory. The KLT tracker and k-means clustering are used for interest-point-based motion analysis; then, four constraints are proposed to further determine the connectivity of interest points belonging to one traffic stream cluster. Finally, the average speed of a traffic stream as well as density and volume can be estimated using outputs from previous steps and reference markings. Our method was tested on five videos taken in very different scenarios. The experimental results show that in our case studies, the proposed method achieves about 96% and 87% accuracy in estimating average traffic stream speed and vehicle count, respectively. The method also achieves a fast processing speed that enables real-time traffic information estimation.

[1]  Qian Yu,et al.  Motion pattern interpretation and detection for tracking moving vehicles in airborne video , 2009, CVPR.

[2]  Saeid Nahavandi,et al.  Efficient Road Detection and Tracking for Unmanned Aerial Vehicle , 2015, IEEE Transactions on Intelligent Transportation Systems.

[3]  Ramakant Nevatia,et al.  Car detection in low resolution aerial images , 2003, Image Vis. Comput..

[4]  Xuelong Li,et al.  Vehicle detection and tracking in airborne videos by multi-motion layer analysis , 2011, Machine Vision and Applications.

[5]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yunpeng Wang,et al.  Long short-term memory neural network for traffic speed prediction using remote microwave sensor data , 2015 .

[7]  Robert A. Schowengerdt,et al.  Airborne video registration and traffic-flow parameter estimation , 2005, IEEE Transactions on Intelligent Transportation Systems.

[8]  Yinhai Wang,et al.  Freeway Traffic Speed Estimation with Single-Loop Outputs , 2000 .

[9]  Zhibin Li,et al.  Motion-vector clustering for traffic speed detection from UAV video , 2015, 2015 IEEE First International Smart Cities Conference (ISC2).

[10]  M. Eichner,et al.  Autonomous Real-time Vehicle Detection from a Medium-Level UAV , 2009 .

[11]  Line Eikvil,et al.  Classification-based vehicle detection in high-resolution satellite images , 2009 .

[12]  Taewan Oh,et al.  Developing a UAV-based rapid mapping system for emergency response , 2009, Defense + Commercial Sensing.

[13]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[14]  Suman Srinivasan,et al.  Airborne traffic surveillance systems: video surveillance of highway traffic , 2004, VSSN '04.

[15]  Zu Whan Kim Realtime Road Detection by Learning from One Example , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[16]  Hsu-Yung Cheng,et al.  Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks , 2012, IEEE Transactions on Image Processing.

[17]  Robert Pless,et al.  Road extraction from motion cues in aerial video , 2004, GIS '04.

[18]  Zhuojun Jiang,et al.  Estimating Annual Average Daily Traffic from Satellite Imagery and Air Photos: Empirical Results , 2003 .

[19]  Pingkun Yan,et al.  Ego motion guided particle filter for vehicle tracking in airborne videos , 2014, Neurocomputing.

[20]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[21]  Martial Hebert,et al.  A Flow-Based Approach to Vehicle Detection and Background Mosaicking in Airborne Video , 2005, CVPR.

[22]  Kimon P. Valavanis,et al.  Generating Traffic Statistical Profiles Using Unmanned Helicopter-Based Video Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[23]  Guohui Zhang,et al.  Video-Based Vehicle Detection and Classification System for Real-Time Traffic Data Collection Using Uncalibrated Video Cameras , 2007, Transportation Research Record: Journal of the Transportation Research Board.

[24]  Uwe Stilla,et al.  Automatic vehicle extraction from airborne LiDAR data of urban areas aided by geodesic morphology , 2010, Pattern Recognit. Lett..

[25]  Wen Liu,et al.  Vehicle Extraction and Speed Detection from Digital Aerial Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[27]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[28]  Uwe Stilla,et al.  Context-supported vehicle detection in optical satellite images of urban areas , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[29]  Dorota A. Grejner-Brzezinska,et al.  Extracting dynamic spatial data from airborne imaging sensors to support traffic flow estimation , 2006 .

[30]  Xuelong Li,et al.  Vehicle Detection and Motion Analysis in Low-Altitude Airborne Video Under Urban Environment , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Pascal Vasseur,et al.  A Vision Algorithm for Dynamic Detection of Moving Vehicles with a UAV , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[32]  Mark D. Hickman,et al.  Methods of analyzing traffic imagery collected from aerial platforms , 2003, IEEE Trans. Intell. Transp. Syst..

[33]  Srikanth Saripalli,et al.  Road detection from aerial imagery , 2012, 2012 IEEE International Conference on Robotics and Automation.

[34]  B. Coifman,et al.  Surface Transportation Surveillance from Unmanned Aerial Vehicles , 2003 .

[35]  Xuelong Li,et al.  Linear SVM classification using boosting HOG features for vehicle detection in low-altitude airborne videos , 2011, 2011 18th IEEE International Conference on Image Processing.