Comparison of performance of object-based image analysis techniques available in open source software (Spring and Orfeo Toolbox/Monteverdi) considering very high spatial resolution data

Abstract. The use of unmanned aerial vehicles (UAVs) for remote sensing applications is becoming more frequent. However, this type of information can result in several software problems related to the huge amount of data available. Object-based image analysis (OBIA) has proven to be superior to pixel-based analysis for very high-resolution images. The main objective of this work was to explore the potentialities of the OBIA methods available in two different open source software applications, Spring and OTB/Monteverdi, in order to generate an urban land cover map. An orthomosaic derived from UAVs was considered, 10 different regions of interest were selected, and two different approaches were followed. The first one (Spring) uses the region growing segmentation algorithm followed by the Bhattacharya classifier. The second approach (OTB/Monteverdi) uses the mean shift segmentation algorithm followed by the support vector machine (SVM) classifier. Two strategies were followed: four classes were considered using Spring and thereafter seven classes were considered for OTB/Monteverdi. The SVM classifier produces slightly better results and presents a shorter processing time. However, the poor spectral resolution of the data (only RGB bands) is an important factor that limits the performance of the classifiers applied.

[1]  Lorenzo Bruzzone,et al.  A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Guaraci J. Erthal,et al.  Satellite Imagery Segmentation: a region growing approach , 1996 .

[3]  J. A. Tullis,et al.  Synergistic Use of Lidar and Color Aerial Photography for Mapping Urban Parcel Imperviousness , 2003 .

[4]  Sérgio Freire,et al.  Introducing mapping standards in the quality assessment of buildings extracted from very high resolution satellite imagery , 2014 .

[5]  Lloyd L. Coulter,et al.  NEAR REAL-TIME CHANGE DETECTION FOR BORDER MONITORING , 2011 .

[6]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[7]  Thomas Blaschke,et al.  An Object-Based Workflow to Extract Landforms at Multiple Scales From Two Distinct Data Types , 2013, IEEE Geoscience and Remote Sensing Letters.

[8]  Michael Gruber,et al.  DSM AND TRUE ORTHO GENERATION WITH THE ULTRACAM-L -- A CASE STUDY , 2010 .

[9]  Dongping Ming,et al.  Semivariogram-Based Spatial Bandwidth Selection for Remote Sensing Image Segmentation With Mean-Shift Algorithm , 2012, IEEE Geoscience and Remote Sensing Letters.

[10]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[11]  B. Uma Shankar,et al.  Novel Classification and Segmentation Techniques with Application to Remotely Sensed Images , 2007, Trans. Rough Sets.

[12]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[13]  C. Woodcock,et al.  Combining Spectral and Texture Data in the Segmentation of Remotely Sensed Images , 1996 .

[14]  Julien Michel,et al.  Stable Mean-Shift Algorithm and Its Application to the Segmentation of Arbitrarily Large Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[15]  F. López-Granados,et al.  Multi-temporal mapping of the vegetation fraction in early-season wheat fields using images from UAV , 2014 .

[16]  I. Song,et al.  Working Set Selection Using Second Order Information for Training Svm, " Complexity-reduced Scheme for Feature Extraction with Linear Discriminant Analysis , 2022 .

[17]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Jinling Wang,et al.  Object-Based Change Detection Using Georeferenced Uav Images , 2012 .

[19]  Rongjun Qin,et al.  An Object-Based Hierarchical Method for Change Detection Using Unmanned Aerial Vehicle Images , 2014, Remote. Sens..

[20]  T. Schmugge,et al.  Research Article: Using Unmanned Aerial Vehicles for Rangelands: Current Applications and Future Potentials , 2006 .

[21]  Liangpei Zhang,et al.  An Adaptive Mean-Shift Analysis Approach for Object Extraction and Classification From Urban Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  R. Hall,et al.  Incorporating texture into classification of forest species composition from airborne multispectral images , 2000 .

[24]  R. Congalton.  A Quantitative Method to Test for Consistency and Correctness in Photointerpretation , 1983 .

[25]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[26]  Alain Trémeau,et al.  A region growing and merging algorithm to color segmentation , 1997, Pattern Recognit..

[27]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[28]  S. Sader,et al.  Comparison of change-detection techniques for monitoring tropical forest clearing and vegetation regrowth in a time series , 2001 .

[29]  Jordi Inglada,et al.  Automatic recognition of man-made objects in high resolution optical remote sensing images by SVM classification of geometric image features , 2007 .

[30]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[31]  S. Franklin,et al.  Aerial Image Texture Information in the Estimation of Northern Deciduous and Mixed Wood Forest Leaf Area Index (LAI) , 1998 .

[32]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[33]  N. Jiang,et al.  2008 International Workshop on Earth Observation and Remote Sensing Applications Semi-automatic Building Extraction from High Resolution Imagery Based on Segmentation , 2022 .

[34]  Peijun Li,et al.  Multispectral image segmentation by a multichannel watershed‐based approach , 2007 .

[35]  Lia Duarte,et al.  Forest fire risk maps: a GIS open source application – a case study in Norwest of Portugal , 2013, Int. J. Geogr. Inf. Sci..

[36]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[37]  Craig A. Coburn,et al.  A multiscale texture analysis procedure for improved forest stand classification , 2004 .

[38]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[39]  Won Suk Lee,et al.  Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees , 2013 .

[40]  Thomas Blaschke,et al.  Object-oriented image analysis and scale-space: Theory and methods for modeling and evaluating multi-scale landscape structure , 2001 .

[41]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[42]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[43]  Lorenzo Bruzzone,et al.  Kernel methods for remote sensing data analysis , 2009 .

[44]  Gilberto Câmara,et al.  Spring: integrating remote sensing and gis by object-oriented data modelling , 1996, Comput. Graph..

[45]  Wenxiong Kang,et al.  General Research on Image Segmentation Algorithms , 2009 .

[46]  A. C. Teodoro,et al.  Exploration of the OBIA methods available in SPRING noncommercial software to UAV data processing , 2014, Remote Sensing.

[47]  J. M. Hans du Buf,et al.  A review of recent texture segmentation and feature extraction techniques , 1993 .

[48]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[49]  Josef Kittler,et al.  Region growing: a new approach , 1998, IEEE Trans. Image Process..

[50]  Albert Rango,et al.  Texture and Scale in Object-Based Analysis of Subdecimeter Resolution Unmanned Aerial Vehicle (UAV) Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Y. Zhang,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES WITH REMOTE SENSING PERSPECTIVE , 2010 .

[52]  C. Woodcock,et al.  Classification and Change Detection Using Landsat TM Data: When and How to Correct Atmospheric Effects? , 2001 .

[53]  Liang Cheng,et al.  Cultivated land information extraction from high-resolution unmanned aerial vehicle imagery data , 2014 .

[54]  Alistair Reid,et al.  1-Point RANSAC for extended Kalman filtering: Application to real-time structure from motion and visual odometry , 2010 .

[55]  A. Rango,et al.  UNMANNED AERIAL VEHICLES FOR RANGELAND MAPPING AND MONITORING: A COMPARISON OF TWO SYSTEMS , 2007 .

[56]  A. Lobo,et al.  Fine-scale mapping of a grassland from digitized aerial photography: an approach using image segmentation and discriminant analysis , 1998 .

[57]  Chulhee Lee,et al.  Bayes error evaluation of the Gaussian ML classifier , 2000, IEEE Trans. Geosci. Remote. Sens..

[58]  F. López-Granados,et al.  Weed Mapping in Early-Season Maize Fields Using Object-Based Analysis of Unmanned Aerial Vehicle (UAV) Images , 2013, PloS one.

[59]  A. S. Lalibertea,et al.  Hierarchical object-based classification of ultra-high-resolution digital mapping camera ( DMC ) imagery for rangeland mapping and assessment , 2010 .

[60]  Chulhee Lee,et al.  Feature extraction based on the Bhattacharyya distance , 2003, Pattern Recognit..

[61]  J. Schiewe,et al.  SEGMENTATION OF HIGH-RESOLUTION REMOTELY SENSED DATA - CONCEPTS, APPLICATIONS AND PROBLEMS , 2002 .

[62]  R.P.H.M. Schoenmakers,et al.  Segmentation Of Remotely-sensed Images: A Re-definition For Operational Applications , 1991, [Proceedings] IGARSS'91 Remote Sensing: Global Monitoring for Earth Management.

[63]  William J. Emery,et al.  Classification of Very High Spatial Resolution Imagery Using Mathematical Morphology and Support Vector Machines , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Chein-I Chang,et al.  Parallel Implementation of the Recursive Approximation of an Unsupervised Hierarchical Segmentation Algorithm. Chapter 5 , 2008 .

[65]  Jianhua Gong,et al.  UAV Remote Sensing for Urban Vegetation Mapping Using Random Forest and Texture Analysis , 2015, Remote. Sens..

[66]  D. Roberts,et al.  A comparison of methods for monitoring multitemporal vegetation change using Thematic Mapper imagery , 2002 .

[67]  G. Hay,et al.  An automated object-based approach for the multiscale image segmentation of forest scenes , 2005 .

[68]  Steven W. Zucker,et al.  Region growing: Childhood and adolescence* , 1976 .

[69]  Pierre Soille,et al.  Morphological Texture Features for Unsupervised and Supervised Segmentations of Natural Landscapes , 2007, IEEE Transactions on Geoscience and Remote Sensing.