Fast road detection and tracking in aerial videos

We propose a fast approach for detecting and tracking a specific road in aerial videos. It combines adaptive Gaussian Mixture Models (GMMs) to describe road colour distributions, and homography based tracking to track road geometries, where an efficient technique is developed to estimate homography transformations between two frames. Experiments are conducted on videos captured by our unmanned aerial vehicles. All the results demonstrate the effectiveness of our proposed method. We test 1755 frames from 5 videos. Our approach can achieve 0.032 seconds per frame and 2.64% segmentation error for images with 908 × 513 resolutions, on average.

[1]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[4]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[5]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[6]  Xiao Xiao,et al.  Vision-based road-following using a small autonomous aircraft , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[7]  Dmitry B. Goldgof,et al.  Using color profiles for street detection in low-altitude UAV video , 2009, Defense + Commercial Sensing.

[8]  Lei Wei,et al.  Texture aware image segmentation using graph cuts and active contours , 2013, Pattern Recognit..

[9]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[10]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[12]  Chee Peng Lim,et al.  Video Driven Traffic Modelling in Paramics , 2013, 2013 UKSim 15th International Conference on Computer Modelling and Simulation.

[13]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[14]  W. Grossman,et al.  Autonomous Searching and Tracking of a River using an UAV , 2007, 2007 American Control Conference.

[15]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[16]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[17]  Srikanth Saripalli,et al.  Road detection from aerial imagery , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Jun Zhou,et al.  Road tracking in aerial images based on human–computer interaction and Bayesian filtering , 2006 .

[19]  Michael T. Orchard,et al.  Color quantization of images , 1991, IEEE Trans. Signal Process..

[20]  Maridalia Guerrero Pena.  A comparative study of three image matching algorithms: SIFT, SURF, and FAST , 2011 .

[21]  Raja Sengupta,et al.  Vision-Based Following of Structures Using an Unmanned Aerial Vehicle (UAV) , 2006 .

[22]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[23]  M. Foedisch,et al.  Adaptive real-time road detection using neural networks , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[24]  Cláudio Rosito Jung,et al.  A robust linear-parabolic model for lane following , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[25]  Justin Talbot,et al.  Implementing GrabCut , 2004 .

[26]  Seiichi Mita,et al.  Robust Road Detection and Tracking in Challenging Scenarios Based on Markov Random Fields With Unsupervised Learning , 2012, IEEE Transactions on Intelligent Transportation Systems.

[27]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[29]  In So Kweon,et al.  Finding and tracking road lanes using "line-snakes" , 1996, Proceedings of Conference on Intelligent Vehicles.

[30]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[31]  B. Coifman,et al.  Surface Transportation Surveillance from Unmanned Aerial Vehicles , 2003 .