On Detecting Road Regions in a Single UAV Image

Automatic detection of road regions in aerial images remains a challenging research topic. Most existing approaches work well on the requirement of users to provide some seedlike points/strokes in the road area as the initial location of road regions, or detecting particular roads such as well-paved roads or straight roads. This paper presents a fully automatic approach that can detect generic roads from a single unmanned aerial vehicles (UAV) image. The proposed method consists of two major components: automatic generation of road/nonroad seeds and seeded segmentation of road areas. To know where roads probably are (i.e., road seeds), a distinct road feature is proposed based on the stroke width transformation (SWT) of road image. To the best of our knowledge, it is the first time to introduce SWT as road features, which show the effectiveness on capturing road areas in images in our experiments. Different road features, including the SWT-based geometry information, colors, and width, are then combined to classify road candidates. Based on the candidates, a Gaussian mixture model is built to produce road seeds and background seeds. Finally, starting from these road and background seeds, a convex active contour model segmentation is proposed to extract whole road regions. Experimental results on varieties of UAV images demonstrate the effectiveness of the proposed method. Comparison with existing techniques shows the robustness and accuracy of our method to different roads.

[1]  Ashok Samal,et al.  Semi-Automated Road Detection From High Resolution Satellite Images by Directional Morphological Enhancement and Segmentation Techniques , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Aluir Porfírio Dal Poz,et al.  Object-Space Road Extraction in Rural Areas Using Stereoscopic Aerial Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[3]  Aluir Porfírio Dal Poz,et al.  Three-Dimensional Semiautomatic Road Extraction From a High-Resolution Aerial Image by Dynamic-Programming Optimization in the Object Space , 2010, IEEE Geoscience and Remote Sensing Letters.

[4]  Zu Whan Kim Realtime Road Detection by Learning from One Example , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[5]  Yonatan Wexler,et al.  Detecting text in natural scenes with stroke width transform , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Srikanth Saripalli,et al.  Road Detection and Tracking from Aerial Desert Imagery , 2012, J. Intell. Robotic Syst..

[7]  Xiao Xiao,et al.  Vision-based road-following using a small autonomous aircraft , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[8]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Peter Wonka,et al.  Road Network Extraction and Intersection Detection From Aerial Images by Tracking Road Footprints , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Sahar Movaghati,et al.  Road Extraction From Satellite Images Using Particle Filtering and Extended Kalman Filtering , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[12]  B. Coifman,et al.  Surface Transportation Surveillance from Unmanned Aerial Vehicles , 2003 .

[13]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[14]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Gregory Dudek,et al.  A vision-based boundary following framework for aerial vehicles , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Cem Ünsalan,et al.  Road Network Detection Using Probabilistic and Graph Theoretical Methods , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Wenzhong Shi,et al.  The line segment match method for extracting road network from high-resolution satellite images , 2002, IEEE Trans. Geosci. Remote. Sens..

[18]  Saeid Nahavandi,et al.  Fast road detection and tracking in aerial videos , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[19]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Yi Lin,et al.  Mini-UAV-Borne LIDAR for Fine-Scale Mapping , 2011, IEEE Geoscience and Remote Sensing Letters.

[21]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  Saeid Nahavandi,et al.  Efficient Road Detection and Tracking for Unmanned Aerial Vehicle , 2015, IEEE Transactions on Intelligent Transportation Systems.

[23]  Lei Wei,et al.  Texture aware image segmentation using graph cuts and active contours , 2013, Pattern Recognit..

[24]  Leo Grady,et al.  A Seeded Image Segmentation Framework Unifying Graph Cuts And Random Walker Which Yields A New Algorithm , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Jianfei Cai,et al.  Robust Interactive Image Segmentation Using Convex Active Contours , 2012, IEEE Transactions on Image Processing.

[26]  Srikanth Saripalli,et al.  Road detection from aerial imagery , 2012, 2012 IEEE International Conference on Robotics and Automation.

[27]  Wolfgang Eckstein,et al.  AUTOMATIC ROAD EXTRACTION IN RURAL AREAS , 1999 .

[28]  Xavier Bresson,et al.  Geometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction , 2010, J. Sci. Comput..

[29]  Haihong Li,et al.  Road extraction from aerial and satellite images by dynamic programming , 1995 .

[30]  Jan Dirk Wegner,et al.  A Higher-Order CRF Model for Road Network Extraction , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[32]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[33]  Raja Sengupta,et al.  Vision-Based Monitoring of Locally Linear Structures Using an Unmanned Aerial Vehicle , 2008 .