Classified road detection from satellite images based on perceptual organization

Extracting roads from satellite images is an important task in both research and practice. This work presents an improved model for road detection based on the principles of perceptual organization and classification fusion in human vision system (HVS). The model consists of four levels: pixels, primitives, structures and objects, and two additional sub‐processes: automatic classification of road scenes and global integration of multiform roads. Based on the model, a novel algorithm for detecting roads from satellite images is also proposed, in which two types of road primitives, namely blob‐like primitive and line‐like primitive are defined, measured, extracted and linked using different methods for dissimilar road scenes. A hierarchical search strategy driven by saliency measurement is adopted in both linking processes. The blob primitives are linked using heuristic grouping and the line primitives are connected through genetic algorithm (GA) evolution. Finally, all of the linked road segments are normalized with centre‐main lines and integrated into global smooth road curves through tensor voting. Experimental results show that the algorithm is capable of detecting multiform roads from real satellite images with high adaptability and reliability.

[1]  Ruben Gonzalez,et al.  Perceptual grouping of natural images for CBIR , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[2]  Haihong Li,et al.  Linear Feature Extraction with 3-D LSB-Snakes , 1997 .

[3]  Jake K. Aggarwal,et al.  Retrieval by classification of images containing large manmade objects using perceptual grouping , 2002, Pattern Recognit..

[4]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[5]  Fabio Dell'Acqua,et al.  Detection of urban structures in SAR images by robust fuzzy clustering algorithms: the example of street tracking , 2001, IEEE Trans. Geosci. Remote. Sens..

[6]  Hong Zhang,et al.  Road network extraction in high resolution SAR images , 2004, IGARSS.

[7]  Gérard G. Medioni,et al.  Inferring global perceptual contours from local features , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Curt H. Davis,et al.  Fully automated road network extraction from high-resolution satellite multispectral imagery , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[9]  Scott T. Acton,et al.  Cloud tracking by scale space classification , 2002, IEEE Trans. Geosci. Remote. Sens..

[10]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[11]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[13]  Trish Keaton,et al.  A level set method for the extraction of roads from multispectral imagery , 2002, Applied Imagery Pattern Recognition Workshop, 2002. Proceedings..

[14]  Zhang Hong,et al.  Road network extraction in high resolution SAR images , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Xuan Li,et al.  The research of road extraction for high resolution satellite image , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[16]  Martin A. Fischler,et al.  Detection of roads and linear structures in low-resolution aerial imagery using a multisource knowledge integration technique☆ , 1981 .

[17]  Luiz Alberto Lisboa da Silva Cardoso.  Computer-Aided Recognition of Man-Made Structures in Aerial Photographs , 1999 .

[18]  Hichem Sahli,et al.  A model-based approach to the automatic extraction of linear features from airborne images , 2001, IEEE Trans. Geosci. Remote. Sens..

[19]  Rama Chellappa,et al.  Edge Detection and Linear Feature Extraction Using a 2-D Random Field Model , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Ivan Laptev.  Road Extraction Based on Line Extraction and Snakes , 1997 .

[21]  Manuele Bicego,et al.  Automatic road extraction from aerial images by probabilistic contour tracking , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[22]  Jocelyn Chanussot,et al.  Fuzzy fusion techniques for linear features detection in multitemporal SAR images , 1999, IEEE Trans. Geosci. Remote. Sens..

[23]  Ying Wang,et al.  Recognition of roads and bridges in SAR images , 1998, Pattern Recognit..

[24]  Johannes R. Sveinsson,et al.  Street tracking based on SAR data from urban areas , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[25]  C. Koch,et al.  Models of bottom-up and top-down visual attention , 2000 .

[26]  Xiaoying Jin,et al.  Multispectral IKONOS imagery automatic road extraction from high-resolution , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[27]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[28]  Li Tang,et al.  Finding main road seeds based on symmetrical edge orientation histogram , 2004 .

[29]  Stefan Hinz,et al.  Automatic extraction of urban road networks from multi-view aerial imagery , 2003 .

[30]  Keith Price,et al.  Road Grid Extraction and Verification , 1998 .

[31]  Yen-Wei Chen,et al.  Segmentation of high resolution satellite images by direction and morphological filters , 2004, Fourth International Conference on Hybrid Intelligent Systems (HIS'04).

[32]  Ki-Sang Hong,et al.  Road detection in spaceborne SAR images using a genetic algorithm , 2002, IEEE Trans. Geosci. Remote. Sens..

[33]  Jean-Francois Mangin,et al.  Detection of linear features in SAR images: application to road network extraction , 1998, IEEE Trans. Geosci. Remote. Sens..

[34]  Paul M. Treitz,et al.  Road network detection from SPOT imagery for updating geographical information systems in the rural-urban fringe , 1992, Int. J. Geogr. Inf. Sci..

[35]  Ryosuke Shibasaki,et al.  Semi-automatic road extraction from high-resolution satellite image , 2002 .

[36]  Rakesh Mohan,et al.  Book review: PERCEPTUAL ORGANIZATION AND VISUAL RECOGNITION by David G. Lowe (Kluwer Academic Publishers) , 1987, SGAR.

[37]  Rama Chellappa,et al.  Extraction of Straight Lines in Aerial Images , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Costas Armenakis,et al.  Survey of Work on Road Extraction in Aerial and Satellite Images , 2002 .

[39]  Stefan Hinz.  A fusion strategy for extraction of urban road nets form multiple images , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[40]  E. Baltsavias,et al.  Automatic Extraction of Man-Made Objects from Aerial and Space Images (II) , 1995 .

[41]  Heung-Kyu Lee,et al.  Towards knowledge-based extraction of roads from 1 m-resolution satellite images , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[42]  Layachi Bentabet,et al.  Road vectors update using SAR imagery: a snake-based method , 2003, IEEE Trans. Geosci. Remote. Sens..

[43]  David M. McKeown,et al.  Cooperative methods for road tracking in aerial imagery , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Felicitas Willrich.  QUALITY CONTROL AND UPDATING OF ROAD DATA BY GIS-DRIVEN ROAD EXTRACTION FROM IMAGERY , 2002 .

[45]  Mihai Datcu,et al.  Road detection in dense urban areas using SAR imagery and the usefulness of multiple views , 2002, IEEE Trans. Geosci. Remote. Sens..

[46]  Chunsun Zhang,et al.  Updating of cartographic road databases by image analysis , 2001 .