Image-based seabed classification: what can we learn from terrestrial remote sensing?

Maps that depict the distribution of substrate, habitat or biotope types on the seabed are in increasing demand by marine ecologists and spatial planners, underpinning decision making in relation to marine spatial planning and marine protected area network design. Yet, the science discipline of image-based seabed mapping has not fully matured and rapid progress is needed to improve the reliability and accuracy of maps. To speed up the process we have conducted a literature review of common practices in terrestrial image classification based on remote sensing data, a related discipline, albeit with a larger scientific community and longer history. We identified the following key elements of a mapping workflow: (i) Data pre-processing, (ii) Feature extraction, (iii) Feature selection, (iv) Classification, (v) Post-classification enhancements, and (vi) Evaluation of classification performance. Insights gained from the review served as a baseline against which recent seabed mapping studies were compared. In this way we identified knowledge gaps and propose modifications to the mapping workflow. A main concern in current seabed mapping practice is that a large amount of often correlated predictor features is extracted, creating a multidimensional feature space. To effectively fill this space with an appropriate amount of training samples is likely to be impossible. Hence, it is necessary to reduce the dimensionality of the feature space via data transformation [e.g. principal component analysis (PCA)] or feature selection and remove correlated features. We propose to make dimensionality reduction an integral part of any mapping workflow. We also suggest to adopt recommendations for accuracy assessment originally drawn up for terrestrial land cover mapping. These include the publication of two or more measures of accuracy including overall and class-specific metrics, publication of associated confidence limits and the provision of the error matrix.

[1]  Daniel Ierodiaconou,et al.  Wave exposure as a predictor of benthic habitat distribution on high energy temperate reefs , 2015, Front. Mar. Sci..

[2]  Markus Diesing,et al.  A multi-model ensemble approach to seabed mapping , 2015 .

[3]  Chris Roelfsema,et al.  Long term land cover and seagrass mapping using Landsat and object-based image analysis from 1972 to 2010 in the coastal environment of South East Queensland, Australia , 2011 .

[4]  P. Lawton,et al.  Using object‐based image analysis to determine seafloor fine‐scale features and complexity , 2015 .

[5]  Stephen V. Stehman,et al.  Selecting and interpreting measures of thematic classification accuracy , 1997 .

[6]  V. Lucieer,et al.  Do marine substrates 'look' and 'sound' the same? Supervised classification of multibeam acoustic data using autonomous underwater vehicle images , 2013 .

[7]  T. Therneau,et al.  An Introduction to Recursive Partitioning Using the RPART Routines , 2015 .

[8]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[9]  Sigeru Omatu,et al.  Remote sensing image analysis using a neural network and knowledge-based processing , 1997 .

[10]  Caiyun Zhang,et al.  Object-based benthic habitat mapping in the Florida Keys from hyperspectral imagery , 2013 .

[11]  B. M. Costa,et al.  The semi-automated classification of acoustic imagery for characterizing coral reef ecosystems , 2013 .

[12]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[13]  Craig J. Brown,et al.  Multiple methods, maps, and management applications: Purpose made seafloor maps in support of ocean management , 2012 .

[14]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[15]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[16]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[17]  G. Foody Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[18]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[19]  Simon Albert,et al.  Mapping coral reefs at reef to reef-system scales, 10s–1000s km2, using object-based image analysis , 2013 .

[20]  Stuart R. Phinn,et al.  Mapping Fish Community Variables by Integrating Field and Satellite Data, Object-Based Image Analysis and Modeling in a Traditional Fijian Fisheries Management Area , 2011, Remote. Sens..

[21]  Stephen V. Stehman,et al.  Design and Analysis for Thematic Map Accuracy Assessment: Fundamental Principles , 1998 .

[22]  Peter F. Fisher,et al.  Spatial analysis of remote sensing image classification accuracy , 2012 .

[23]  R. Hilborn,et al.  Investigating the effects of mobile bottom fishing on benthic biota: a systematic review protocol , 2014, Environmental Evidence.

[24]  Walter H. F. Smith,et al.  Global Sea Floor Topography from Satellite Altimetry and Ship Depth Soundings , 1997 .

[25]  Mark J. Carlotto,et al.  Effect of errors in ground truth on classification accuracy , 2009 .

[26]  Lene Buhl-Mortensen,et al.  Prediction of benthic biotopes on a Norwegian offshore bank using a combination of multivariate analysis and GIS classification , 2009 .

[27]  Colin Brown,et al.  Neural network classification of multibeam backscatter and bathymetry data from Stanton Bank (Area IV) , 2009 .

[28]  M. Daily,et al.  Hue-saturation-intensity split-spectrum processing of Seasat radar imagery , 1983 .

[29]  W. Loh,et al.  SPLIT SELECTION METHODS FOR CLASSIFICATION TREES , 1997 .

[30]  Mark Zimmermann,et al.  A bottom-up methodology for integrating underwater video and acoustic mapping for seafloor substrate classification , 2007 .

[31]  Stuart C. Sides,et al.  Processing, mosaicking and management of the Monterey Bay digital sidescan-sonar images , 2002 .

[32]  David A. Patterson,et al.  Toward estimation of map accuracy without a probability test sample , 2003, Environmental and Ecological Statistics.

[33]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[34]  F. Marchese,et al.  Mapping Cold-Water Coral Habitats at Different Scales within the Northern Ionian Sea (Central Mediterranean): An Assessment of Coral Coverage and Associated Vulnerability , 2014, PloS one.

[35]  Alexandre C. G. Schimel,et al.  Integrating Multibeam Backscatter Angular Response, Mosaic and Bathymetry Data for Benthic Habitat Mapping , 2014, PloS one.

[36]  G. W. Milligan,et al.  An examination of procedures for determining the number of clusters in a data set , 1985 .

[37]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[38]  Stefan B. Williams,et al.  Filling the gaps: Predicting the distribution of temperate reef biota using high resolution biological and acoustic data , 2014 .

[39]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[40]  Daniel Ierodiaconou,et al.  Combining angular response classification and backscatter imagery segmentation for benthic biological habitat mapping , 2012 .

[41]  Philippe Blondel,et al.  Textural analyses of multibeam sonar imagery from Stanton Banks, Northern Ireland continental shelf , 2009 .

[42]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[43]  David Ryan,et al.  Habitat Classification of Temperate Marine Macroalgal Communities Using Bathymetric LiDAR , 2014, Remote. Sens..

[44]  Pål Buhl-Mortensen,et al.  An evaluation of compiled single-beam bathymetry data as a basis for regional sediment and biotope mapping , 2014 .

[45]  S. Phinn,et al.  Multi-scale, object-based image analysis for mapping geomorphic and ecological zones on coral reefs , 2012 .

[46]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[47]  Jay Calvert,et al.  An evaluation of supervised and unsupervised classification techniques for marine benthic habitat mapping using multibeam echosounder data , 2015 .

[48]  G. Fader,et al.  Benthic habitat mapping on the Scotian Shelf based on multibeam bathymetry, surficial geology and sea floor photographs , 2001 .

[49]  Philippe Blondel,et al.  The Handbook of Sidescan Sonar , 2009 .

[50]  J. Schiewe,et al.  SEGMENTATION OF HIGH-RESOLUTION REMOTELY SENSED DATA - CONCEPTS, APPLICATIONS AND PROBLEMS , 2002 .

[51]  Hyunjoong Kim,et al.  Classification Trees With Unbiased Multiway Splits , 2001 .

[52]  D. Simons,et al.  A Bayesian approach to seafloor classification using multi-beam echo-sounder backscatter data , 2009 .

[53]  Jo Wood,et al.  Where is Helvellyn? Fuzziness of multi‐scale landscape morphometry , 2004 .

[54]  Daniel Ierodiaconou,et al.  Evaluation of Four Supervised Learning Methods for Benthic Habitat Mapping Using Backscatter from Multi-Beam Sonar , 2012, Remote. Sens..

[55]  Nicholas J. Tate,et al.  A critical synthesis of remotely sensed optical image change detection techniques , 2015 .

[56]  G. Kendrick,et al.  Modelling distribution of marine benthos from hydroacoustics and underwater video , 2008 .

[57]  Richard G. Lathrop,et al.  Seafloor habitat mapping of the New York Bight incorporating sidescan sonar data , 2006 .

[59]  L.L.F. Janssen,et al.  Accuracy assessment of satellite derived land - cover data : a review , 1994 .

[60]  Witold R. Rudnicki,et al.  Feature Selection with the Boruta Package , 2010 .

[61]  Craig J. Brown,et al.  Spatial scale and geographic context in benthic habitat mapping: review and future directions , 2015 .

[62]  Claude Cariou,et al.  Assessing the performance of two unsupervised dimensionality reduction techniques on hyperspectral APEX data for high resolution urban land-cover mapping , 2014 .

[63]  Samuel J. Purkis,et al.  Remote Sensing and Global Environmental Change , 2011 .

[64]  Daniel C. Dunn,et al.  Marine Geospatial Ecology Tools: An integrated framework for ecological geoprocessing with ArcGIS, Python, R, MATLAB, and C++ , 2010, Environ. Model. Softw..

[65]  Chris McGonigle,et al.  Evaluation of image-based multibeam sonar backscatter classification for benthic habitat discrimination and mapping at Stanton Banks, UK , 2009 .

[66]  S. Fraschetti,et al.  How many habitats are there in the sea (and where) , 2008 .

[67]  V. Lucieer,et al.  Unsupervised fuzzy classification and object-based image analysis of multibeam data to map deep water substrates, Cook Strait, New Zealand , 2011 .

[68]  C. Burnett,et al.  A multi-scale segmentation/object relationship modelling methodology for landscape analysis , 2003 .

[69]  J. Cihlar Land cover mapping of large areas from satellites: Status and research priorities , 2000 .

[70]  P. Moran Notes on continuous stochastic phenomena. , 1950, Biometrika.

[71]  Jacquomo Monk,et al.  Quantification of Spatial and Thematic Uncertainty in the Application of Underwater Video for Benthic Habitat Mapping , 2014 .

[72]  D. Ierodiaconou,et al.  Hydro-acoustic remote sensing of benthic biological communities on the shallow South East Australian continental shelf , 2009 .

[73]  Jacquomo Monk,et al.  Comparison of automated classification techniques for predicting benthic biological communities using hydroacoustics and video observations , 2011 .

[74]  C. Brown,et al.  Mapping benthic habitat in regions of gradational substrata: An automated approach utilising geophysical, geological, and biological relationships , 2008 .

[75]  Markus Diesing,et al.  A Comparison of Supervised Classification Methods for the Prediction of Substrate Type Using Multibeam Acoustic and Legacy Grain-Size Data , 2014, PloS one.

[76]  Markus Diesing,et al.  Mapping seabed sediments: Comparison of manual, geostatistical, object-based image analysis and machine learning approaches , 2014 .

[77]  R. Devillers,et al.  Marine habitat mapping in support of Marine Protected Area management in a subarctic fjord: Gilbert Bay, Labrador, Canada , 2013, Journal of Coastal Conservation.

[78]  Roland L. Redmond,et al.  Estimation and Mapping of Misclassification Probabilities for Thematic Land Cover Maps , 1998 .

[79]  C. Woodcock,et al.  Making better use of accuracy data in land change studies: Estimating accuracy and area and quantifying uncertainty using stratified estimation , 2013 .

[80]  Peter T. Harris,et al.  Why Map Benthic Habitats , 2012 .

[81]  Jonathan Cheung-Wai Chan,et al.  Multiple Criteria for Evaluating Machine Learning Algorithms for Land Cover Classification from Satellite Data , 2000 .

[82]  Giles M. Foody,et al.  Local characterization of thematic classification accuracy through spatially constrained confusion matrices , 2005 .

[83]  James V. Gardner,et al.  Predicting seafloor facies from multibeam bathymetry and backscatter data , 2004 .

[84]  M. Begon,et al.  Ecology: From Individuals to Ecosystems , 2005 .

[85]  Brendan P. Brooke,et al.  Predictive mapping of seabed substrata using high-resolution multibeam sonar data: A case study from a shelf with complex geomorphology , 2014 .

[86]  Lalit Kumar,et al.  Comparative assessment of the measures of thematic classification accuracy , 2007 .

[87]  Philippe Blondel,et al.  Handbook of seafloor sonar imagery , 1997 .

[88]  Giles M. Foody,et al.  Harshness in image classification accuracy assessment , 2008 .

[89]  Ariell Friedman,et al.  Automated interpretation of benthic stereo imagery , 2013 .

[90]  R. Pontius,et al.  Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment , 2011 .

[91]  J. M. Preston,et al.  Automated acoustic seabed classification of multibeam images of Stanton Banks , 2009 .

[92]  Geoffrey J. Hay,et al.  Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline , 2008 .

[93]  J. Strong,et al.  Objective stratification and sampling-effort allocation of ground-truthing in benthic-mapping surveys , 2010 .

[94]  Paul T. Gayes,et al.  Spatially quantitative seafloor habitat mapping: example from the northern South Carolina inner continental shelf , 2004 .

[95]  Sergej Olenin,et al.  The concept of biotope in marine ecology and coastal management. , 2006, Marine pollution bulletin.

[96]  D. Wright,et al.  Introduction to the Special Issue: Marine and Coastal GIS for Geomorphology, Habitat Mapping, and Marine Reserves , 2008 .

[97]  V. Lucieer Object‐oriented classification of sidescan sonar data for mapping benthic marine habitats , 2008 .

[98]  Evan N. Edinger,et al.  Mapping coral and sponge habitats on a shelf-depth environment using multibeam sonar and ROV video observations: Learmonth Bank, northern British Columbia, Canada , 2014 .

[99]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[100]  Michael A. Wulder,et al.  Remote sensing methods in medium spatial resolution satellite data land cover classification of large areas , 2002 .

[101]  Walter H. F. Smith,et al.  New global marine gravity model from CryoSat-2 and Jason-1 reveals buried tectonic structure , 2014, Science.

[102]  R. Ríosmena-Rodríguez,et al.  Benthic habitat β-diversity modeling and landscape metrics for the selection of priority conservation areas using a systematic approach: Magdalena Bay, Mexico, as a case study , 2013 .

[103]  Phaedon C. Kyriakidis,et al.  A geostatistical approach for mapping thematic classification accuracy and evaluating the impact of inaccurate spatial data on ecological model predictions , 2001, Environmental and Ecological Statistics.

[104]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[105]  J. M. Sappington,et al.  Quantifying Landscape Ruggedness for Animal Habitat Analysis: A Case Study Using Bighorn Sheep in the Mojave Desert , 2007 .

[106]  A. D. Gregorio,et al.  Land Cover Classification System (LCCS): Classification Concepts and User Manual , 2000 .

[107]  Daniel Clewley,et al.  Updating the Phase 1 habitat map of Wales, UK, using satellite sensor data , 2011 .

[108]  J. Guinan,et al.  Multiscale Terrain Analysis of Multibeam Bathymetry Data for Habitat Mapping on the Continental Slope , 2007 .

[109]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[110]  J. V. Soares,et al.  Distribution of aboveground live biomass in the Amazon basin , 2007 .

[111]  R. MacMillan,et al.  Chapter 9 Landforms and Landform Elements in Geomorphometry , 2009 .

[112]  Richard A. Wadsworth,et al.  Final Report for LCM2007 - the new UK land cover map. Countryside Survey Technical Report No 11/07 , 2011 .

[113]  Craig J. Brown,et al.  Benthic habitat mapping: A review of progress towards improved understanding of the spatial ecology of the seafloor using acoustic techniques , 2011 .

[114]  B. Calder,et al.  Angular range analysis of acoustic themes from Stanton Banks Ireland: A link between visual interpretation and multibeam echosounder angular signatures , 2009 .

[115]  David L. Verbyla,et al.  Conservative bias in classification accuracy assessment due to pixel-by-pixel comparison of classified images with reference grids , 1995 .

[116]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[117]  Stefan B. Williams,et al.  Predictive habitat models from AUV-based multibeam and optical imagery , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[118]  S. Ventura,et al.  THE INTEGRATION OF GEOGRAPHIC DATA WITH REMOTELY SENSED IMAGERY TO IMPROVE CLASSIFICATION IN AN URBAN AREA , 1995 .

[119]  Tina Wunderlich,et al.  Application of 2D Fourier filtering for elimination of stripe noise in side-scan sonar mosaics , 2012, Geo-Marine Letters.

[120]  Zhi Huang,et al.  Predictive modelling of seabed sediment parameters using multibeam acoustic data: a case study on the Carnarvon Shelf, Western Australia , 2012, Int. J. Geogr. Inf. Sci..