Road boundary estimation to improve vehicle detection and tracking in UAV video

Video processing is one challenge in collecting vehicle trajectories from unmanned aerial vehicle (UAV) and road boundary estimation is one way to improve the video processing algorithms. However, current methods do not work well for low volume road, which is not well-marked and with noises such as vehicle tracks. A fusion-based method termed Dempster-Shafer-based road detection (DSRD) is proposed to address this issue. This method detects road boundary by combining multiple information sources using Dempster-Shafer theory (DST). In order to test the performance of the proposed method, two field experiments were conducted, one of which was on a highway partially covered by snow and another was on a dense traffic highway. The results show that DSRD is robust and accurate, whose detection rates are 100% and 99.8% compared with manual detection results. Then, DSRD is adopted to improve UAV video processing algorithm, and the vehicle detection and tracking rate are improved by 2.7% and 5.5%, respectively. Also, the computation time has decreased by 5% and 8.3% for two experiments, respectively.

[1]  Dinggang Shen,et al.  Lane detection using spline model , 2000, Pattern Recognit. Lett..

[2]  H. Zimmermann,et al.  Quantifying vagueness in decision models , 1985 .

[3]  Ki-Sang Hong,et al.  Fast line segment grouping method for finding globally more favorable line segments , 2002, Pattern Recognit..

[4]  Robert Pless,et al.  Detecting Roads in Stabilized Video with the Spatio-Temporal Structure Tensor , 2006, GeoInformatica.

[5]  Sridhar Lakshmanan,et al.  Lane Boundary Detection Using Deformable Templates: Effects of Image Subsampling on Detected Lane Edge , 1995, ACCV.

[6]  Zhong-Ren Peng,et al.  A UAV-Based Automatic Traffic Incident Detection System for Low Volume Roads , 2013 .

[7]  Mark D. Hickman,et al.  Methods of analyzing traffic imagery collected from aerial platforms , 2003, IEEE Trans. Intell. Transp. Syst..

[8]  Mark Hickman,et al.  Estimation of a Road Mask to Improve Vehicle Detection and Tracking in Airborne Imagery , 2012 .

[9]  Xutong Niu,et al.  A semi-automatic framework for highway extraction and vehicle detection based on a geometric deformable model , 2006 .

[10]  Serge P. Hoogendoorn,et al.  Heterogeneity In Car-Following Behavior: Theory And Empirics , 2011 .

[11]  Pitu B. Mirchandani,et al.  Airborne Traffic Flow Data and Traffic Management , 2008 .

[12]  Stevica Graovac,et al.  Detection of Road Image Borders Based on Texture Classification , 2012 .

[13]  Mark R. McCord,et al.  Roadway traffic monitoring from an unmanned aerial vehicle , 2006 .

[14]  Eric Brassart,et al.  A New Method for the Estimation of Mass Functions in the Dempster–Shafer’s Evidence Theory: Application to Colour Image Segmentation , 2011, Circuits Syst. Signal Process..

[15]  S. P. Hoogendoorn,et al.  Microscopic Traffic Data Collection by Remote Sensing , 2003 .

[16]  Suhong Ko,et al.  Lane departure identification on highway with searching the region of interest on hough space , 2007, 2007 International Conference on Control, Automation and Systems.

[17]  Juan Carlos Augusto,et al.  Mass function derivation and combination in multivariate data spaces , 2010, Inf. Sci..

[18]  Reza Ghaderi,et al.  A novel fuzzy Dempster-Shafer inference system for brain MRI segmentation , 2013, Inf. Sci..

[19]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[20]  Serge P. Hoogendoorn,et al.  Empirical Analysis of Merging Behavior at Freeway On-Ramp , 2010 .

[21]  Zhong-Ren Peng,et al.  Multi-objective evolutionary approach for UAV cruise route planning to collect traffic information , 2012, Journal of Central South University.

[22]  Serge P. Hoogendoorn,et al.  Processing Traffic Data Collected by Remote Sensing , 2009 .

[23]  Javaid Iqbal,et al.  On the Improvement of Multi-Legged Locomotion over Difficult Terrains Using a Balance Stabilization Method: , 2012 .

[24]  N. H. C. Yung,et al.  Lane detection by orientation and length discrimination , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[25]  E. Teoh,et al.  LANE DETECTION USING CATMULL-ROM SPLINE , 1998 .

[26]  Kurt Kubik,et al.  Automatic Building Detection Using the Dempster-Shafer Algorithm , 2006 .

[27]  Sankaran Mahadevan,et al.  A new method to determine basic probability assignment from training data , 2013, Knowledge-Based Systems.