Using object‐based image analysis to determine seafloor fine‐scale features and complexity

Autonomous and remotely operated underwater vehicles equipped with high‐definition video and photographic cameras are used to perform benthic surveys. These devices record fine‐scale (< 1 m) seafloor features (seafloor complexity) and their local (10–100s m) variability (seafloor heterogeneity). Here, we introduce a methodology to efficiently process this optical imagery using object‐based image analysis, which reduces the pixels in high‐resolution digital images into a collection of “image‐objects” of homogeneous color and/or luminosity. This approach uses intuitive user‐defined parameters and reproducible computer code, which aims to facilitate comparisons between habitats and geographic regions. We test this methodology with 511 images taken on the seafloor of a glaciated continental shelf (Gulf of Maine, northwest Atlantic), and describe three applications: (1) estimating percent cover of conspicuous epibenthic fauna by building a Random Forest binary classifier assigning an identity to image‐objects; (2) correlating image complexity (number of image‐objects) with mean particle grain size; and (3) estimating seafloor heterogeneity from local variability in image complexity within and between two physiographic regions. Percent cover of epibenthic fauna estimated by the Random Forest binary classifier was in close agreement with the human visual assessment. Mean particle grain size (ϕ scale) was inversely correlated with image complexity (maximum Spearman's ρ = −0.89, p < 0.01) with images dominated by pebbles, cobbles, boulders (low on ϕ scale) yielding high image complexity. Predictive relationships of sediment composition were established using polynomial regression. Lastly, our approach could differentiate habitats within and between physiographic regions by using mean seafloor complexity and local variability along transects.

[1]  C. Wentworth A Scale of Grade and Class Terms for Clastic Sediments , 1922, The Journal of Geology.

[2]  Michael J. Risk,et al.  Fish Diversity on a Coral Reef in the Virgin Islands , 1972 .

[3]  R. Kettig,et al.  Classification of Multispectral Image Data by Extraction and Classification of Homogeneous Objects , 1976, IEEE Transactions on Geoscience Electronics.

[4]  G. Fader,et al.  Surficial geology of the eastern Gulf of Maine and Bay of Fundy , 1977 .

[5]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  K. Sebens Habitat structure and community dynamics in marine benthic systems , 1991 .

[7]  J. Syvitski Towards an understanding of sediment deposition on glaciated continental shelves , 1991 .

[8]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Earl D. McCoy,et al.  Habitat Structure: The Evolution and Diversification of a Complex Topic , 1991 .

[10]  A. Keast Habitat Structure: The Physical Arrangement of Objects in Space. Based on a Symposium Held at the University of South Florida, May 1988.Susan S. Bell , Earl D. McCoy , Henry R. Mushinsky , 1992 .

[11]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[12]  Y. Loya,et al.  Flow patterns induced by substrata and body morphologies of benthic organisms, and their roles in determining availability of food particles , 1993 .

[13]  D. Wethey,et al.  Settlement and early post-settlement survival of sessile marine invertebrates on topographically complex surfaces: the importance of refuge dimensions and adult morphology , 1996 .

[14]  E. Bourget,et al.  Influence of topographic heterogeneity and spatial scales on the structure of the neighbouring intertidal endobenthic macrofaunal community , 1997 .

[15]  Michael F. Goodchild,et al.  Data from the Deep: Implications for the GIS Community , 1997, Int. J. Geogr. Inf. Sci..

[16]  Aggelos K. Katsaggelos,et al.  Hybrid image segmentation using watersheds and fast region merging , 1998, IEEE Trans. Image Process..

[17]  Warwick Mules Review: The Image , 2000 .

[18]  G. Steeves,et al.  Canadian imaging and sampling technology for studying marine benthic habitat and biological communities , 2000 .

[19]  Geoffrey M. Jacquez,et al.  From fields to objects: A review of geographic boundary analysis , 2000, J. Geogr. Syst..

[20]  D. Belknap,et al.  Deglaciation of the Gulf of Maine , 2001 .

[21]  G. Fader,et al.  Benthic habitat mapping on the Scotian Shelf based on multibeam bathymetry, surficial geology and sea floor photographs , 2001 .

[22]  Deglacial history and relative sea-level changes, northern New England and adjacent Canada , 2001 .

[23]  Philippe Blondel,et al.  Textural analyses of sidescan sonar imagery from two mound provinces in the Porcupine Seabight , 2002 .

[24]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  DAVID L. STRAYER,et al.  A Classification of Ecological Boundaries , 2003 .

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  D. Rubin A Simple Autocorrelation Algorithm for Determining Grain Size from Digital Images of Sediment , 2004 .

[28]  Jonathan H. Grabowski,et al.  HABITAT COMPLEXITY DISRUPTS PREDATOR–PREY INTERACTIONS BUT NOT THE TROPHIC CASCADE ON OYSTER REEFS , 2004 .

[29]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[30]  Johan Erlandsson,et al.  The relative importance of habitat complexity and surface area in assessing biodiversity: Fractal application on rocky shores , 2005 .

[31]  J. Deming,et al.  Global bathymetric patterns of standing stock and body size in the deep-sea benthos , 2006 .

[32]  G. Fader,et al.  A conceptual model of the deglaciation of Atlantic Canada , 2006 .

[33]  David M. Rubin,et al.  Field test comparison of an autocorrelation technique for determining grain size using a digital 'beachball' camera versus traditional methods , 2007 .

[34]  Daniel Buscombe,et al.  Estimation of grain-size distributions and associated parameters from digital images of sediment , 2008 .

[35]  V. Lucieer Object‐oriented classification of sidescan sonar data for mapping benthic marine habitats , 2008 .

[36]  Paolo Menesatti,et al.  A Novel Morphometry-Based Protocol of Automated Video-Image Analysis for Species Recognition and Activity Rhythms Monitoring in Deep-Sea Fauna , 2009, Sensors.

[37]  D. Hochuli,et al.  Independent effects of patch size and structural complexity on diversity of benthic macroinvertebrates. , 2010, Ecology.

[38]  P. Lawton,et al.  Biodiversity Knowledge and its Application in the Gulf of Maine Area , 2010 .

[39]  Nick Barnes Publish your computer code: it is good enough , 2010, Nature.

[40]  P Ganesan,et al.  Segmentation and edge detection of color images using CIELAB color space and edge detectors , 2010, INTERACT-2010.

[41]  Thomas J. Webb,et al.  Biodiversity's Big Wet Secret: The Global Distribution of Marine Biological Records Reveals Chronic Under-Exploration of the Deep Pelagic Ocean , 2010, PloS one.

[42]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[43]  Francesca Antonucci,et al.  Automated Image Analysis for the Detection of Benthic Crustaceans and Bacterial Mat Coverage Using the VENUS Undersea Cabled Network , 2011, Sensors.

[44]  Jaume Piera,et al.  Hierarchical segmentation-based software for cover classification analyses of seabed images (Seascape) , 2011 .

[45]  L. Buhl‐Mortensen,et al.  Habitat complexity and bottom fauna composition at different scales on the continental shelf and slope of northern Norway , 2012, Hydrobiologia.

[46]  Craig J. Brown,et al.  Benthic habitat mapping: A review of progress towards improved understanding of the spatial ecology of the seafloor using acoustic techniques , 2011 .

[47]  V. Lucieer,et al.  Unsupervised fuzzy classification and object-based image analysis of multibeam data to map deep water substrates, Cook Strait, New Zealand , 2011 .

[48]  Zhi Huang,et al.  A new approach to mapping marine benthic habitats using physical environmental data , 2011 .

[49]  Brian J. Todd,et al.  Surficial geology and benthic habitat of the German Bank seabed, Scotian Shelf, Canada , 2011 .

[50]  Matthew H Todd,et al.  Open science is a research accelerator. , 2011, Nature chemistry.

[51]  R. Peng Reproducible Research in Computational Science , 2011, Science.

[52]  Z. Al-Hamdani,et al.  Seabed geomorphic features in a glaciated shelf of the Baltic Sea , 2012 .

[53]  R. Tong,et al.  Multivariate Statistical Analysis of Distribution of Deep-Water Gorgonian Corals in Relation to Seabed Topography on the Norwegian Margin , 2012, PloS one.

[54]  N. Holbrook,et al.  Image-based continental shelf habitat mapping using novel automated data extraction techniques , 2012 .

[55]  Jennifer M. Urban,et al.  Shining Light into Black Boxes , 2012, Science.

[56]  Stephen J. Smith,et al.  Exploring the role of environmental variables in shaping patterns of seabed biodiversity composition in regional‐scale ecosystems , 2012, The Journal of applied ecology.

[57]  F. Tuya,et al.  Post larval, short-term, colonization patterns: The effect of substratum complexity across subtidal, adjacent, habitats , 2012 .

[58]  V. Lucieer,et al.  Do marine substrates 'look' and 'sound' the same? Supervised classification of multibeam acoustic data using autonomous underwater vehicle images , 2013 .

[59]  Lael Parrott,et al.  A comparison of two techniques for the rapid assessment of marine habitat complexity , 2013 .

[60]  B. Bett,et al.  Autonomous Underwater Vehicles (AUVs): Their past, present and future contributions to the advancement of marine geoscience , 2014 .

[61]  Markus Diesing,et al.  Mapping seabed sediments: Comparison of manual, geostatistical, object-based image analysis and machine learning approaches , 2014 .

[62]  V. Huvenne,et al.  Megafaunal distribution and biodiversity in a heterogeneous landscape: the iceberg scoured Rockall Bank, NE Atlantic , 2014 .

[63]  Markus Diesing,et al.  A Comparison of Supervised Classification Methods for the Prediction of Substrate Type Using Multibeam Acoustic and Legacy Grain-Size Data , 2014, PloS one.

[64]  P. Sivakumar,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES , 2016 .