Building Roof Segmentation from Aerial Images Using a Line-and Region-Based Watershed Segmentation Technique

In this paper, we present a novel strategy for roof segmentation from aerial images (orthophotoplans) based on the cooperation of edge- and region-based segmentation methods. The proposed strategy is composed of three major steps. The first one, called the pre-processing step, consists of simplifying the acquired image with an appropriate couple of invariant and gradient, optimized for the application, in order to limit illumination changes (shadows, brightness, etc.) affecting the images. The second step is composed of two main parallel treatments: on the one hand, the simplified image is segmented by watershed regions. Even if the first segmentation of this step provides good results in general, the image is often over-segmented. To alleviate this problem, an efficient region merging strategy adapted to the orthophotoplan particularities, with a 2D modeling of roof ridges technique, is applied. On the other hand, the simplified image is segmented by watershed lines. The third step consists of integrating both watershed segmentation strategies into a single cooperative segmentation scheme in order to achieve satisfactory segmentation results. Tests have been performed on orthophotoplans containing 100 roofs with varying complexity, and the results are evaluated with the VINETcriterion using ground-truth image segmentation. A comparison with five popular segmentation techniques of the literature demonstrates the effectiveness and the reliability of the proposed approach. Indeed, we obtain a good segmentation rate of 96% with the proposed method compared to 87.5% with statistical region merging (SRM), 84% with mean shift, 82% with color structure code (CSC), 80% with efficient graph-based segmentation algorithm (EGBIS) and 71% with JSEG.

[1]  Elena Angiati,et al.  Identification of roofs perimeter from aerial and satellite images , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[2]  N. Chehata,et al.  OBJECT-BASED FOREST CHANGE DETECTION USING HIGH RESOLUTION SATELLITE IMAGES , 2013 .

[3]  Xuewen Zhang,et al.  Remote sensing image segmentation based on self-organizing map at multiple-scale , 2007, Geoinformatics.

[4]  Clive S. Fraser,et al.  Automatic Segmentation of Raw LIDAR Data for Extraction of Building Roofs , 2014, Remote. Sens..

[5]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[6]  Xavier Cufí,et al.  Strategies for image segmentation combining region and boundary information , 2003, Pattern Recognit. Lett..

[7]  Shukui Bo,et al.  On Combining Region-Growing with Non-Parametric Clustering for Color Image Segmentation , 2008, 2008 Congress on Image and Signal Processing.

[8]  Thierry Carron Segmentations d'images couleur dans la base teinte-luminance-saturation : approche numérique et symbolique , 1995 .

[9]  Mohamad M. Awad,et al.  Satellite image segmentation using Self- Organizing Maps and Fuzzy C-Means , 2009, 2009 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[10]  Patrick De Smet,et al.  Implementation and analysis of an optimized rainfalling watershed algorithm , 2000, Electronic Imaging.

[11]  Th. Gevers,et al.  Object recognition based on photometric color invariants , 1997 .

[12]  Junjie Guo,et al.  A new hybrid image segmentation method for fingerprint identification , 2011, 2011 IEEE International Conference on Computer Science and Automation Engineering.

[13]  Jiri Matas,et al.  Colour-based object recognition , 1995 .

[14]  Lutz Priese,et al.  Fast and Robust Segmentation of Natural Color Scenes , 1998, ACCV.

[15]  P. Mayaux,et al.  An object-based method for mapping and change analysis in mangrove ecosystems , 2008 .

[16]  Marinette Revenu,et al.  Segmentation d'images couleur : applications en microscopie cellulaire , 2000 .

[17]  Michel Grimaud,et al.  New measure of contrast: the dynamics , 1992, Optics & Photonics.

[18]  Theo Gevers,et al.  Robust histogram construction from color invariants for object recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  A. Özgün AUTOMATED DESCRIPTION OF 2-D BUILDING BOUNDARIES FROM A SINGLE COLOR AERIAL ORTHO-IMAGE , 2009 .

[20]  L. Vinet Segmentation et mise en correspondance de régions de paires d'images stéréoscopiques , 1991 .

[21]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  S. Beucher,et al.  Morphological segmentation , 1990, J. Vis. Commun. Image Represent..

[23]  Dong-Chen He,et al.  Approach to nonparametric cooperative multiband segmentation with adaptive threshold. , 2009, Applied optics.

[24]  Polina Golland,et al.  Motion from Color , 1997, Comput. Vis. Image Underst..

[25]  Juliane Junker,et al.  Color Image Processing And Applications , 2016 .

[26]  Norbert Pfeifer,et al.  Automatic Roof Plane Detection and Analysis in Airborne Lidar Point Clouds for Solar Potential Assessment , 2009, Sensors.

[27]  Marina Mueller,et al.  Edge- and region-based segmentation technique for the extraction of large, man-made objects in high-resolution satellite imagery , 2004, Pattern Recognit..

[28]  Emanuele Trucco,et al.  Improving Feature Tracking with Robust Statistics , 1999, Pattern Analysis & Applications.

[29]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Jake K. Aggarwal,et al.  The Integration of Image Segmentation Maps using Region and Edge Information , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Pascal Fua,et al.  Automatic Extraction of Generic House Roofs from High Resolution Aerial Imagery , 1996, ECCV.

[32]  Didier Zugaj,et al.  A new approach of color images segmentation based on fusing region and edge segmentations outputs , 1998, Pattern Recognit..

[33]  Sigeru Omatu,et al.  Lip detection by the use of neural networks , 2007, Artificial Life and Robotics.

[34]  G. Wang,et al.  A Novel Hybrid Segmentation Method for Medical Images Based on Level Set , 2009, 2009 2nd International Congress on Image and Signal Processing.

[35]  Laurent Najman,et al.  Geodesic Saliency of Watershed Contours and Hierarchical Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Jean Marc Salotti,et al.  Gestion des informations dans les premieres etapes de la vision par ordinateur. (Information management in the first stages of computer vision) , 1994 .

[37]  Binsheng Zhao,et al.  Marker-controlled watershed for lymphoma segmentation in sequential CT images. , 2006, Medical physics.

[38]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Peter H. N. de With,et al.  Localization of buildings with a gable roof in very high-resolution aerial images , 2011, Electronic Imaging.

[40]  Geoffrey E. Hinton,et al.  Learning to Detect Roads in High-Resolution Aerial Images , 2010, ECCV.

[41]  P. Sivakumar,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES , 2016 .

[42]  Thomas Blaschke,et al.  Ontology-Based Classification of Building Types Detected from Airborne Laser Scanning Data , 2014, Remote. Sens..

[43]  Jianping Fan,et al.  Automatic image segmentation by integrating color-edge extraction and seeded region growing , 2001, IEEE Trans. Image Process..

[44]  Sheng Chen,et al.  Segmentation of Multi-spectral Satellite Images Based on Watershed Algorithm , 2008, 2008 International Symposium on Knowledge Acquisition and Modeling.

[45]  Danny De Vleeschauwer,et al.  Activity driven nonlinear diffusion for color image watershed segmentation , 1999, J. Electronic Imaging.

[46]  Kacem Chehdi,et al.  Automatic image segmentation system through iterative edge - region co-operation , 2002, Image Vis. Comput..

[47]  Anil P.N.,et al.  A Novel Approach Using Active Contour Model for Semi-Automatic Road Extraction from High Resolution Satellite Imagery , 2010, 2010 Second International Conference on Machine Learning and Computing.

[48]  Louahdi Khoudour,et al.  People re-identification by spectral classification of silhouettes , 2010, Signal Process..

[49]  C. Unsalan,et al.  Building detection from aerial images using invariant color features and shadow information , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[50]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[51]  SoillePierre,et al.  Watersheds in Digital Spaces , 1991 .

[52]  C. Garbay,et al.  6 - Une approche opportuniste et coopérative pour la vision de bas niveau , 1995 .

[53]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[54]  H. K. Abhyankar,et al.  A Hybrid Segmentation Model based on Watershed and Gradient Vector Flow for the Detection of Brain Tumor 29 , 2009 .

[55]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[56]  T. Gevers,et al.  UvA-DARE ( Digital Academic Repository ) Robust Histogram Construction from Color Invariants for Object Recognition , 2003 .

[57]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Gerald Schaefer How Useful are Colour Invariants for Image Retrieval? , 2004, ICCVG.

[59]  Roger Fjørtoft,et al.  Segmentation d'images radar par détection de contours , 1999 .

[60]  Yonghak Song,et al.  BUILDING EXTRACTION FROM HIGH RESOLUTION COLOR IMAGERY BASED ON EDGE FLOW DRIVEN ACTIVE CONTOUR AND JSEG , 2008 .

[61]  Gerald Schaefer,et al.  Illuminant and device invariant colour using histogram equalisation , 2005, Pattern Recognit..

[62]  Xavier Cufí,et al.  A new approach to segmentation based on fusing circumscribed contours, region growing and clustering , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[63]  Longin Jan Latecki,et al.  Image retrieval and reversible illumination normalization , 2005, IS&T/SPIE Electronic Imaging.

[64]  Qiuxiao Chen,et al.  Fast Segmentation of High-Resolution Satellite Images Using Watershed Transform Combined with an Efficient Region Merging Approach , 2004, IWCIA.

[65]  Michèle Gouiffès Apports de la couleur et des modèles de réflexion pour l'extraction et le suivi de primitives , 2005 .

[66]  Junichi Susaki Segmentation of Shadowed Buildings in Dense Urban Areas from Aerial Photographs , 2012, Remote. Sens..

[67]  C. Fraser,et al.  Automatic extraction of building roofs using LIDAR data and multispectral imagery , 2013 .

[68]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..