Detecting Building Edges from High Spatial Resolution Remote Sensing Imagery Using Richer Convolution Features Network

As the basic feature of building, building edges play an important role in many fields such as urbanization monitoring, city planning, surveying and mapping. Building edges detection from high spatial resolution remote sensing (HSRRS) imagery has always been a long-standing problem. Inspired by the recent success of deep-learning-based edge detection, a building edge detection model using a richer convolutional features (RCF) network is employed in this paper to detect building edges. Firstly, a dataset for building edges detection is constructed by the proposed most peripheral constraint conversion algorithm. Then, based on this dataset the RCF network is retrained. Finally, the edge probability map is obtained by RCF-building model, and this paper involves a geomorphological concept to refine edge probability map according to geometric morphological analysis of topographic surface. The experimental results suggest that RCF-building model can detect building edges accurately and completely, and that this model has an edge detection F-measure that is at least 5% higher than that of other three typical building extraction methods. In addition, the ablation experiment result proves that using the most peripheral constraint conversion algorithm can generate more superior dataset, and the involved refinement algorithm shows a higher F-measure and better visual effect contrasted with the non-maximal suppression algorithm.

[1]  Yongyang Xu,et al.  Building Extraction in Very High Resolution Remote Sensing Imagery Using Deep Learning and Guided Filters , 2018, Remote. Sens..

[2]  Florence Tupin,et al.  Extraction and Three-Dimensional Reconstruction of Isolated Buildings in Urban Scenes From High-Resolution Optical and SAR Spaceborne Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jinhui Tang,et al.  Richer Convolutional Features for Edge Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jitendra Malik,et al.  Learning to Detect Natural Image Boundaries Using Brightness and Texture , 2002, NIPS.

[5]  Sanja Fidler,et al.  Monocular Object Instance Segmentation and Depth Ordering with CNNs , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Martino Pesaresi,et al.  A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural Measure , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Martino Pesaresi,et al.  Improved Textural Built-Up Presence Index for Automatic Recognition of Human Settlements in Arid Regions With Scattered Vegetation , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Catherine Mering,et al.  Extraction of buildings in very high spatial resolution's GeoEye images, an approach through the mathematical morphology , 2016, 2016 11th Iberian Conference on Information Systems and Technologies (CISTI).

[9]  Ryosuke Shibasaki,et al.  A Boundary Regulated Network for Accurate Roof Segmentation and Outline Extraction , 2018, Remote. Sens..

[10]  Lin Xiangguo,et al.  Extraction of Human Settlements from High Resolution Remote Sensing Imagery by Fusing Features of Right Angle Corners and Right Angle Sides , 2017 .

[11]  Wang Min Research on information extraction and target recognition from high resolution remote sensing image , 2005 .

[12]  Chunhong Pan,et al.  Building extraction from multi-source remote sensing images via deep deconvolution neural networks , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[13]  Lu Guojun,et al.  A New Building Mask Using the Gradient of Heights for Automatic Building Extraction , 2016 .

[14]  Ramakant Nevatia,et al.  Detection of buildings using perceptual grouping and shadows , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Luis Ángel Ruiz Fernández,et al.  Evaluation of Automatic Building Detection Approaches Combining High Resolution Images and LiDAR Data , 2011, Remote. Sens..

[16]  Rick Siow Mong Goh,et al.  Transfer Hashing: From Shallow to Deep , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Bin Wang,et al.  Deep Convolutional networks with superpixel segmentation for hyperspectral image classification , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[18]  Zhengjun Liu,et al.  Building extraction from high resolution imagery based on multi-scale object oriented classification and probabilistic Hough transform , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[19]  Amr H. Abd-Elrahman,et al.  Building Extraction from High Resolution Space Images in High Density Residential Areas in the Great Cairo Region , 2011, Remote. Sens..

[20]  Jianbo Shi,et al.  High-for-Low and Low-for-High: Efficient Boundary Detection from Deep Object Features and Its Applications to High-Level Vision , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[21]  Deren Li,et al.  Development of a multi-scale object-based shadow detection method for high spatial resolution image , 2015 .

[22]  S. Cui,et al.  Complex building description and extraction based on Hough transformation and cycle detection , 2012 .

[23]  Wei-Yun Yau,et al.  Structured AutoEncoders for Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[24]  Li Yong,et al.  ADAPTIVE BUILDING EDGE DETECTION BY COMBINING LIDAR DATA AND AERIAL IMAGES , 2008 .

[25]  Hervé Le Men,et al.  Building detection by Markov object processes , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[26]  Clive S. Fraser,et al.  3D building reconstruction from high-resolution Ikonos stereo imagery , 2001 .

[27]  Xiangyun Hu,et al.  Object-Based Analysis of Airborne LiDAR Data for Building Change Detection , 2014, Remote. Sens..

[28]  Jianping Li,et al.  Automated Reconstruction of Building LoDs from Airborne LiDAR Point Clouds Using an Improved Morphological Scale Space , 2017, Remote. Sens..

[29]  Taejung Kim,et al.  Development of a graph-based approach for building detection , 1999, Image Vis. Comput..

[30]  Mohammad Awrangjeb,et al.  A Novel Building Change Detection Method Using 3D Building Models , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[31]  Jin Zhao,et al.  Superpixel-Based Multiple Local CNN for Panchromatic and Multispectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Liangpei Zhang,et al.  A New Building Extraction Postprocessing Framework for High-Spatial-Resolution Remote-Sensing Imagery , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Ali J. Ghandour,et al.  Autonomous Building Detection Using Edge Properties and Image Color Invariants , 2018 .

[34]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[35]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Kan Pei-ta Building Extraction Using High Resolution Imagery , 2014 .

[37]  Yerach Doytsher,et al.  Right‐Angle Rooftop Polygon Extraction in Regularised Urban Areas: Cutting the Corners , 2004 .

[38]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[39]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Fredric C. Gey,et al.  The relationship between recall and precision , 1994 .

[41]  Jianbo Shi,et al.  DeepEdge: A multi-scale bifurcated deep network for top-down contour detection , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Naci Yastikli,et al.  Automatic building extraction using LiDAR and aerial photographs , 2013 .

[43]  Zhang Shu-bi Semi-automated extraction from aerial image using improved Hough transformation , 2006 .

[44]  Jing Peng,et al.  An improved snake model for building detection from urban aerial images , 2005, Pattern Recognit. Lett..

[45]  LI Zhi-juan Spatial Relation-Aided Method for Object-Oriented Extraction of Buildings from High Resolution Image , 2012 .

[46]  Li Pan,et al.  Local Edge Distributions for Detection of Salient Structure Textures and Objects , 2013, IEEE Geosci. Remote. Sens. Lett..

[47]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  M. Siegel,et al.  Hyperspectral classification via deep networks and superpixel segmentation , 2015 .

[49]  Shihong Du,et al.  Extracting building patterns with multilevel graph partition and building grouping , 2016 .

[50]  Hamid Abrishami Moghaddam,et al.  Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[51]  Peter Reinartz,et al.  Building Outline Extraction Using a Heuristic Approach Based on Generalization of Line Segments , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[52]  Jiang Han,et al.  Fully convolutional networks for building and road extraction: Preliminary results , 2016 .

[53]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Zhong Chen,et al.  End-to-End Airplane Detection Using Transfer Learning in Remote Sensing Images , 2018, Remote. Sens..

[55]  Victor S. Lempitsky,et al.  N4-Fields: Neural Network Nearest Neighbor Fields for Image Transforms , 2014, ArXiv.

[56]  Liangpei Zhang,et al.  Morphological Building/Shadow Index for Building Extraction From High-Resolution Imagery Over Urban Areas , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[57]  Clive S. Fraser,et al.  Automatic Segmentation of Raw LIDAR Data for Extraction of Building Roofs , 2014, Remote. Sens..

[58]  Yiming Yan,et al.  Object-Based Dense Matching Method for Maintaining Structure Characteristics of Linear Buildings , 2018, Sensors.

[59]  Guojun Lu,et al.  An Automatic Building Extraction and Regularisation Technique Using LiDAR Point Cloud Data and Orthoimage , 2016, Remote. Sens..

[60]  Mustafa Turker,et al.  Building extraction from high-resolution optical spaceborne images using the integration of support vector machine (SVM) classification, Hough transformation and perceptual grouping , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[61]  Dejan Grigillo,et al.  Automated building extraction from IKONOS images in suburban areas , 2012 .

[62]  Takayoshi Yamashita,et al.  Multiple Object Extraction from Aerial Imagery with Convolutional Neural Networks , 2016, IRIACV.

[63]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[64]  P. Raju,et al.  Shadow Analysis Technique for Extraction of Building Height using High Resolution Satellite Single Image and Accuracy Assessment , 2014 .

[65]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[66]  Hao Wu,et al.  An object-based image analysis for building seismic vulnerability assessment using high-resolution remote sensing imagery , 2014, Natural Hazards.

[67]  Shihong Du,et al.  Mining parameter information for building extraction and change detection with very high-resolution imagery and GIS data , 2017 .

[68]  Jian Liu,et al.  A new approach to extract rectangular building from aerial urban images , 2002, 6th International Conference on Signal Processing, 2002..

[69]  Tian Jin-wen,et al.  Object-oriented Method of Hierarchical Urban Building Extraction from High-resolution Remote-Sensing Imagery , 2010 .

[70]  Junyu Gao,et al.  Embedding structured contour and location prior in siamesed fully convolutional networks for road detection , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[71]  Antonio J. Plaza,et al.  Efficient implementation of morphological index for building/shadow extraction from remotely sensed images , 2016, The Journal of Supercomputing.

[72]  Guojun Lu,et al.  A Robust Gradient Based Method for Building Extraction from LiDAR and Photogrammetric Imagery , 2016, Sensors.

[73]  Robert T. Collins,et al.  Task driven perceptual organization for extraction of rooftop polygons , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[74]  Lei Hu,et al.  A building extraction method using shadow in high resolution multispectral images , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[75]  Heinz Rüther,et al.  Application of snakes and dynamic programming optimisation technique in modeling of buildings in informal settlement areas , 2002 .

[76]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[77]  Xiangyun Hu,et al.  Remote sensing , 2020, Water Resources in the Mediterranean Region.

[78]  Zhang Zhiqiang,et al.  Combining the Pixel-based and Object-based Methods for Building Change Detection Using High-resolution Remote Sensing Images , 2018 .

[79]  Tan Qu-lin,et al.  Urban Building Extraction from VHR Multi-spectral Images Using Object-based Classification , 2010 .

[80]  Mariana Belgiu,et al.  Comparing supervised and unsupervised multiresolution segmentation approaches for extracting buildings from very high resolution imagery , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[81]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[82]  Shiyong Cui,et al.  Building Change Detection Based on Satellite Stereo Imagery and Digital Surface Models , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[83]  Rama Chellappa,et al.  Delineating buildings by grouping lines with MRFs , 1996, IEEE Trans. Image Process..

[84]  Lin Xiangguo,et al.  Object-based Morphological Building Index for Building Extraction from High Resolution Remote Sensing Imagery , 2017 .