Quantitative experimental comparison of single-beam, sidescan, and multibeam benthic habitat maps

Map comparison is a relatively uncommon practice in acoustic seabed classification to date, contrary to the field of land remote sensing, where it has been developed extensively over recent decades. The aim here is to illustrate the benefits of map comparison in the underwater realm with a case study of three maps independently describing the seabed habitats of the Te Matuku Marine Reserve (Hauraki Gulf, New Zealand). The maps are obtained from a QTC View classification of a single-beam echosounder (SBES) dataset, manual segmentation of a sidescan sonar (SSS) mosaic, and automatic classification of a backscatter dataset from a multibeam echosounder (MBES). The maps are compared using pixel-to-pixel similarity measures derived from the literature in land remote sensing. All measures agree in presenting the MBES and SSS maps as the most similar, and the SBES and SSS maps as the least similar. The results are discussed with reference to the potential of MBES backscatter as an alternative to SSS mosaic for imagery segmentation and to the potential of joint SBES – SSS survey for improved habitat mapping. Other applications of map-similarity measures in acoustic classification of the seabed are suggested.

[1]  T K Stanton.  On acoustic scattering by a shell-covered seafloor. , 2000, The Journal of the Acoustical Society of America.

[2]  Chandra Giri,et al.  A comparative analysis of the Global Land Cover 2000 and MODIS land cover data sets , 2005 .

[3]  V. Lucieer.  Object‐oriented classification of sidescan sonar data for mapping benthic marine habitats , 2008 .

[4]  K. Bjorndal,et al.  Historical Overfishing and the Recent Collapse of Coastal Ecosystems , 2001, Science.

[5]  John T. Finn,et al.  Use of the Average Mutual Information Index in Evaluating Classification Error and Consistency , 1993, Int. J. Geogr. Inf. Sci..

[6]  W. T. Collins,et al.  Acoustic classification of marine habitats in coastal Newfoundland , 2002 .

[7]  Giles M. Foody,et al.  On the compensation for chance agreement in image classification accuracy assessment, Photogram , 1992 .

[8]  G. Fader,et al.  Benthic habitat mapping on the Scotian Shelf based on multibeam bathymetry, surficial geology and sea floor photographs , 2001 .

[9]  L. Poppe,et al.  Relationships Among Sea-Floor Structure and Benthic Communities in Long Island Sound at Regional and Benthoscape Scales , 2000 .

[10]  J. Hughes Clarke,et al.  Toward remote seafloor classification using the angular response of acoustic backscattering: a case study from multiple overlapping GLORIA data , 1994 .

[11]  Craig J. Brown,et al.  Small-scale Mapping of Sea-bed Assemblages in the Eastern English Channel Using Sidescan Sonar and Remote Sampling Techniques , 2002 .

[12]  Philippe Blondel,et al.  Textural analyses of multibeam sonar imagery from Stanton Banks, Northern Ireland continental shelf , 2009 .

[13]  Dave Reid,et al.  Acoustic seabed classification: current practice and future directions , 2008 .

[14]  K. Ellingsen,et al.  Acoustic classification of seabed habitats using the QTC VIEW™ system , 2002 .

[15]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[16]  Stephen V. Stehman,et al.  Design and Analysis for Thematic Map Accuracy Assessment: Fundamental Principles , 1998 .

[17]  W. T. Collins,et al.  STATISTICAL SEABED SEGMENTATION - FROM IMAGES AND ECHOES TO OBJECTIVE CLUSTERING , 2004 .

[18]  L. Hamilton,et al.  Comparison of RoxAnn and QTC-View acoustic bottom classification system performance for the Cairns area, Great Barrier Reef, Australia , 1999 .

[19]  Giles M. Foody,et al.  Harshness in image classification accuracy assessment , 2008 .

[20]  R. Dodge,et al.  Mapping Coral Reef Habitats in Southeast Florida Using a Combined Technique Approach , 2008 .

[21]  E. K. Pikitch,et al.  Ecosystem-Based Fishery Management , 2004, Science.

[22]  Zhenkui Ma,et al.  Tau coefficients for accuracy assessment of classification of remote sensing data , 1995 .

[23]  L. Atallah,et al.  Wavelet analysis of bathymetric sidescan sonar data for the classification of seafloor sediments in Hopvågen Bay - Norway , 2002 .

[24]  Barry Boots,et al.  Categorical maps, comparisons, and confidence , 2006, J. Geogr. Syst..

[25]  Mapping seabed biotopes at two spatial scales in the eastern English Channel. Part 2. Comparison of two acoustic ground discrimination systems , 2004, Journal of the Marine Biological Association of the United Kingdom.

[26]  Anthony P. Lyons,et al.  Backscattering from bioturbated sediments at very high frequency , 2001 .

[27]  T. Pitcher,et al.  Towards sustainability in world fisheries , 2002, Nature.

[28]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[29]  Ian Sotheran,et al.  Mapping marine benthic biotopes using acoustic ground discrimination systems , 2003 .

[30]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[31]  Henri Theil,et al.  Statistical Decomposition Analysis: With Applications in the Social and Administrative Sciences , 1972 .

[32]  Giles M. Foody.  What is the difference between two maps? A remote senser’s view , 2006, J. Geogr. Syst..

[33]  Alex Hagen-Zanker,et al.  Map comparison methods that simultaneously address overlap and structure , 2006, J. Geogr. Syst..

[34]  L. A. Goodman,et al.  Measures of association for cross classifications , 1979 .

[35]  S. V. Stehman,et al.  Comparing thematic maps based on map value , 1999 .

[36]  P. Archambault,et al.  Acoustic detection of a scallop bed from a single-beam echosounder in the St. Lawrence , 2005 .

[37]  B. Guillaumont,et al.  The REBENT monitoring network, a spatially integrated, acoustic approach to surveying nearshore macrobenthic habitats: application to the Bay of Concarneau (South Brittany, France) , 2006 .

[38]  Jennifer L. Dungan,et al.  Focusing on feature-based differences in map comparison , 2006, J. Geogr. Syst..

[39]  G. Fader,et al.  An overview of seabed-mapping technologies in the context of marine habitat classification , 2000 .

[40]  Veerle A.I. Huvenne,et al.  Acquisition and processing of backscatter data for habitat mapping - comparison of multibeam and sidescan systems , 2009 .

[41]  Giles M. Foody,et al.  Map comparison in GIS , 2007 .

[42]  B. Calder,et al.  Angular range analysis of acoustic themes from Stanton Banks Ireland: A link between visual interpretation and multibeam echosounder angular signatures , 2009 .

[43]  C. Brown,et al.  Mapping benthic habitat in regions of gradational substrata: An automated approach utilising geophysical, geological, and biological relationships , 2008 .

[44]  R. Valente,et al.  A review of approaches for classifying benthic habitats and evaluating habitat quality. , 2004, Journal of environmental management.

[45]  A. Beyer,et al.  Seafloor classification of the mound and channel provinces of the Porcupine Seabight: an application of the multibeam angular backscatter data , 2007 .

[46]  Pierre Legendre,et al.  Acoustic seabed classification: improved statistical method , 2002 .

[47]  Philippe Blondel,et al.  Textural analyses of sidescan sonar imagery from two mound provinces in the Porcupine Seabight , 2002 .

[48]  Giles M. Foody,et al.  Sample size determination for image classification accuracy assessment and comparison , 2009 .

[49]  D. Ierodiaconou,et al.  Marine benthic habitat mapping using Multibeam data, georeferencedvideo and image classification techniques in Victoria, Australia , 2007 .

[50]  W. Michaels.  Review of acoustic seabed classification systems , 2007 .

[51]  R. Grace,et al.  BENTHIC COMMUNITIES WEST OF SLIPPER ISLAND, NORTH-EASTERN NEW ZEALAND , 1974 .

[52]  Stephen V. Stehman.  Design, analysis, and inference for studies comparing thematic accuracy of classified remotely sensed data: a special case of map comparison , 2006, J. Geogr. Syst..

[53]  Paula Couto,et al.  Assessing the accuracy of spatial simulation models , 2003 .

[54]  J. Roberts,et al.  Acoustic mapping using a multibeam echosounder reveals cold-water coral reefs and surrounding habitats , 2005, Coral Reefs.

[55]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[56]  Xavier Lurton,et al.  An Introduction to Underwater Acoustics: Principles and Applications , 2010 .

[57]  Craig J. Brown,et al.  Mapping seabed habitats in the Firth of Lorn off the west coast of Scotland: evaluation and comparison of habitat maps produced using the acoustic ground-discrimination system, RoxAnn, and sidescan sonar , 2005 .

[58]  Jenny S. Collier,et al.  Time-lapse side-scan sonar imaging of bleached coral reefs: A case study from the Seychelles , 2007 .

[59]  S. Nilsson,et al.  A spatial comparison of four satellite derived 1 km global land cover datasets , 2006 .

[60]  N. Pace,et al.  Swathe seabed classification , 1988 .

[61]  A. Lucieer,et al.  Fuzzy clustering for seafloor classification , 2009 .

[62]  Richard S. Appeldoorn,et al.  Improving Coral Reef Habitat Mapping of the Puerto Rico Insular Shelf Using Side Scan Sonar , 2008 .

[63]  R. Leemans,et al.  Comparing global vegetation maps with the Kappa statistic , 1992 .

[64]  Alexandre C. G. Schimel,et al.  Comparison of a Self-Processed EM3000 Multibeam Echosounder Dataset with a QTC View Habitat Mapping and a Sidescan Sonar Imagery, Tamaki Strait, New Zealand , 2010 .

[65]  Colin Brown,et al.  Neural network classification of multibeam backscatter and bathymetry data from Stanton Bank (Area IV) , 2009 .

[66]  D. Simons,et al.  A Bayesian approach to seafloor classification using multi-beam echo-sounder backscatter data , 2009 .

[67]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[68]  Dale J. Prediger,et al.  Coefficient Kappa: Some Uses, Misuses, and Alternatives , 1981 .

[69]  P. Legendre,et al.  MAPPING OF MARINE SOFT-SEDIMENT COMMUNITIES: INTEGRATED SAMPLING FOR ECOLOGICAL INTERPRETATION , 2004 .

[70]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[71]  S. Thrush,et al.  Detection of acoustic class boundaries in soft sediment systems using the seafloor acoustic discrimination system QTC VIEW , 2001 .

[72]  H. Cramér.  Mathematical methods of statistics , 1947 .

[73]  G. Cutter,et al.  Automated segmentation of seafloor bathymetry from multibeam echosounder data using local Fourier histogram texture features , 2003 .

[74]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[75]  Roger White,et al.  Pattern based map comparisons , 2006, J. Geogr. Syst..

[76]  Erica Morris,et al.  Recent Advances in Automated Genus-specific Marine Habitat Mapping Enabled by High-resolution Multibeam Bathymetry , 2005 .

[77]  W. G. Rees,et al.  Comparing the spatial content of thematic maps , 2008 .

[78]  W. Press,et al.  Numerical Recipes in Fortran: The Art of Scientific Computing.@@@Numerical Recipes in C: The Art of Scientific Computing. , 1994 .