Computer vision enables short- and long-term analysis of Lophelia pertusa polyp behaviour and colour from an underwater observatory

An array of sensors, including an HD camera mounted on a Fixed Underwater Observatory (FUO) were used to monitor a cold-water coral (Lophelia pertusa) reef in the Lofoten-Vesterålen area from April to November 2015. Image processing and deep learning enabled extraction of time series describing changes in coral colour and polyp activity (feeding). The image data was analysed together with data from the other sensors from the same period, to provide new insights into the short- and long-term dynamics in polyp features. The results indicate that diurnal variations and tidal current influenced polyp activity, by controlling the food supply. On a longer time-scale, the coral’s tissue colour changed from white in the spring to slightly red during the summer months, which can be explained by a seasonal change in food supply. Our work shows, that using an effective integrative computational approach, the image time series is a new and rich source of information to understand and monitor the dynamics in underwater environments due to the high temporal resolution and coverage enabled with FUOs.

[1]  R. Anderson,et al.  A new laboratory method for monitoring deep-water coral polyp behaviour , 2002, Hydrobiologia.

[2]  SchettiniRaimondo,et al.  Underwater image processing , 2010 .

[3]  T. Lundälv,et al.  Cold-water coral ecosystem (Tisler Reef, Norwegian Shelf) may be a hotspot for carbon cycling , 2012 .

[4]  Aslak Grinsted,et al.  Nonlinear Processes in Geophysics Application of the Cross Wavelet Transform and Wavelet Coherence to Geophysical Time Series , 2022 .

[5]  Tim W. Nattkemper,et al.  Polyp Activity Estimation and Monitoring for Cold Water Corals with a Deep Learning Approach , 2016, 2016 ICPR 2nd Workshop on Computer Vision for Analysis of Underwater Imagery (CVAUI).

[6]  G. Shelton,et al.  Lophelia Pertusa (L.): Electrical Conduction and Behaviour in a Deep-Water Coral , 1980, Journal of the Marine Biological Association of the United Kingdom.

[7]  C. Heip,et al.  The cold‐water coral community as hotspot of carbon cycling on continental margins: A food‐web analysis from Rockall Bank (northeast Atlantic) , 2009 .

[8]  D. Veleda,et al.  Cross-Wavelet Bias Corrected by Normalizing Scales , 2012 .

[9]  Autun Purser,et al.  Tolerance to long-term exposure of suspended benthic sediments and drill cuttings in the cold-water coral Lophelia pertusa. , 2013, Marine pollution bulletin.

[10]  Jörg Ontrup,et al.  Use of machine-learning algorithms for the automated detection of cold-water coral habitats: a pilot study , 2009 .

[11]  J. Verreth,et al.  Water Flow Affects Zooplankton Feeding by the Scleractinian Coral Galaxea fascicularis on a Polyp and Colony Level , 2012 .

[12]  Kostas Kiriakoulakis,et al.  Lipids and nitrogen isotopes of two deep-water corals from the North-East Atlantic: initial results and implications for their nutrition , 2005 .

[13]  Georgios D. Evangelidis,et al.  Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Dag Slagstad,et al.  A model study of demography and spatial distribution of Calanus finmarchicus at the Norwegian coast , 2001 .

[15]  Tim W. Nattkemper,et al.  RecoMIA—Recommendations for Marine Image Annotation: Lessons Learned and Future Directions , 2016, Front. Mar. Sci..

[16]  Jonas Osterloff,et al.  Computational Visual Stress Level Analysis of Calcareous Algae Exposed to Sedimentation , 2016, PloS one.

[17]  Ronald A. Rensink,et al.  On the Failure to Detect Changes in Scenes Across Brief Interruptions , 2000 .

[18]  Thomas Kuhn,et al.  Fully automated image segmentation for benthic resource assessment of poly-metallic nodules , 2016 .

[19]  Andreas Bartels,et al.  Task-Related Edge Density (TED)—A New Method for Revealing Dynamic Network Formation in fMRI Data of the Human Brain , 2015, PloS one.

[20]  J. Berge,et al.  Arctic complexity: a case study on diel vertical migration of zooplankton , 2014, Journal of plankton research.

[21]  Jonas Osterloff,et al.  A computer vision approach for monitoring the spatial and temporal shrimp distribution at the LoVe observatory , 2016 .

[22]  Rune S. Frederiksen,et al.  The fauna associated with the bank-forming deepwater coral Lophelia pertusa (Scleractinaria) on the Faroe shelf , 1992 .

[23]  X. Liang,et al.  Rectification of the Bias in the Wavelet Power Spectrum , 2007 .

[24]  B. Bett,et al.  Organic biogeochemistry of the Darwin Mounds, a deep-water coral ecosystem, of the NE Atlantic , 2004 .

[25]  S. Liaaen-Jensen,et al.  Natural occurrence of enantiomeric and Meso astaxanthin 7∗-crustaceans including zooplankton , 1987 .

[26]  M. Dolan,et al.  Cold-water coral reefs in the Hola glacial trough off Vesterålen, North Norway , 2016, memoirs.

[27]  Jennifer M. Durden,et al.  Comparison of image annotation data generated by multiple investigators for benthic ecology , 2016 .

[28]  Kongelige Norske videnskabers selskab,et al.  Det Kongelige Norske videnskabers selskabs forhandlinger , 1929 .

[29]  K. Tande,et al.  Physical and biological factors influencing the seasonal variation in disatributrion of zooplanton across the shelfat Nordvestbaskem, northern Norway, 1994 , 1999 .

[30]  M. Taviani,et al.  Trophic relationships in a deep Mediterranean cold-water coral bank (Santa Maria di Leuca, Ionian Sea) , 2009 .

[31]  Tim W Nattkemper,et al.  MAIA—A machine learning assisted image annotation method for environmental monitoring and exploration , 2018, PloS one.

[32]  Joost van de Weijer,et al.  Color in Computer Vision: Fundamentals and Applications , 2012 .

[33]  J. Opderbecke,et al.  Morphology and environment of cold-water coral carbonate mounds on the NW European margin , 2007 .

[34]  R. J. Henderson,et al.  Marine wax esters , 1981 .

[35]  Pål Buhl-Mortensen,et al.  Effects of water flow and drilling waste exposure on polyp behaviour in Lophelia pertusa , 2015 .

[36]  A. Davies,et al.  The effect of flow speed and food size on the capture efficiency and feeding behaviour of the cold-water coral Lophelia pertusa , 2016 .

[37]  P. B. Mortensen,et al.  Species diversity and spatial distribution of invertebrates on deep-water Lophelia reefs in Norway , 2008 .

[38]  M. Heath,et al.  The North Atlantic Ocean as habitat for Calanus finmarchicus: Environmental factors and life history traits , 2014 .

[39]  K. Tande,et al.  Spatio-temporal patterns in the copepod community in Malangen, Northern Norway , 1997 .

[40]  Tim W. Nattkemper,et al.  Active Learning for the Classification of Species in Underwater Images from a Fixed Observatory , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[41]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[42]  A. Purser,et al.  The influence of flow velocity and food concentration on Lophelia pertusa (Scleractinia) zooplankton capture rates , 2010 .

[43]  F. Goycoolea,et al.  Astaxanthin: A Review of its Chemistry and Applications , 2006, Critical reviews in food science and nutrition.

[44]  Tim W. Nattkemper,et al.  Change detection in marine observatory image streams using Bi-Domain Feature Clustering , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[45]  Jeremy M Wolfe,et al.  Why don't we see changes? The role of attentional bottlenecks and limited visual memory , 2006, Visual cognition.

[46]  J. Gutt,et al.  Semi-Automated Image Analysis for the Assessment of Megafaunal Densities at the Arctic Deep-Sea Observatory HAUSGARTEN , 2012, PloS one.

[47]  D. Slagstad,et al.  Habitat selection of overwintering Calanus finmarchicus in the NE Norwegian Sea and shelf waters off Northern Norway in 2000–02 , 2003 .

[48]  Marc S. S. Lavaleye,et al.  Particle flux and food supply to a seamount cold-water coral community (Galicia Bank, NW Spain) , 2004 .

[49]  Jan Helge Fosså,et al.  Distribution, abundance and size of Lophelia pertusa coral reefs in mid-Norway in relation to seabed characteristics , 2001, Journal of the Marine Biological Association of the United Kingdom.

[50]  Jens Greinert,et al.  Compact-Morphology-based poly-metallic Nodule Delineation , 2017, Scientific Reports.

[51]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[52]  David M. Lane,et al.  Implementation of a fast coral detector using a supervised machine learning and Gabor Wavelet feature descriptors , 2014, 2014 IEEE Sensor Systems for a Changing Ocean (SSCO)..

[53]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[54]  Brian J. Bett,et al.  Role of cold-water Lophelia pertusa coral reefs as fish habitat in the NE Atlantic , 2005 .

[55]  A. Purser,et al.  Particulate organic matter fluxes and hydrodynamics at the Tisler cold-water coral reef , 2011 .

[56]  G. Tarling,et al.  Midnight sinking behaviour in Calanus finmarchicus: a response to satiation or krill predation? , 2002 .

[57]  Chris Roelfsema,et al.  Towards Automated Annotation of Benthic Survey Images: Variability of Human Experts and Operational Modes of Automation , 2015, PloS one.

[58]  Kenneth D. Hoadley,et al.  Circadian Clock Gene Expression in the Coral Favia fragum over Diel and Lunar Reproductive Cycles , 2011, PloS one.

[59]  C. Young,et al.  Temperature tolerance of the deep-sea coral Lophelia pertusa from the southeastern United States , 2013 .

[60]  Tim W. Nattkemper,et al.  COATL - a learning architecture for online real-time detection and classification assistance for environmental data , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[61]  Tim W. Nattkemper,et al.  BIIGLE 2.0 - Browsing and Annotating Large Marine Image Collections , 2017, Front. Mar. Sci..

[62]  S. Flögel,et al.  Geochemical and physical constraints for the occurrence of living cold-water corals , 2013 .

[63]  Robert H. Shumway,et al.  Time series analysis and its applications : with R examples , 2017 .

[64]  G. Hays,et al.  Individual variability in diel vertical migration of a marine copepod: Why some individuals remain at depth when others migrate , 2001 .

[65]  C. Torrence,et al.  A Practical Guide to Wavelet Analysis. , 1998 .

[66]  Pål Buhl-Mortensen,et al.  Coral reefs in the Southern Barents Sea: habitat description and the effects of bottom fishing , 2017 .

[67]  J. Roberts,et al.  Lipid biomarkers reveal geographical differences in food supply to the cold-water coral Lophelia pertusa (Scleractinia) , 2009 .

[68]  F. Uiblein.  What thrives between the waves and beneath the tides? – Marine Biology Research sails into its second decade , 2015 .

[69]  Tim W. Nattkemper,et al.  Computational coral feature monitoring for the fixed underwater observatory LoVe , 2016, OCEANS 2016 MTS/IEEE Monterey.

[70]  Wilhelm Hasselbring,et al.  Modeling polyp activity of Paragorgia arborea using supervised learning , 2017, Ecol. Informatics.