Deep Image Representations for Coral Image Classification

Healthy coral reefs play a vital role in maintaining biodiversity in tropical marine ecosystems. Remote imaging techniques have facilitated the scientific investigations of these intricate ecosystems, particularly at depths beyond 10 m where SCUBA diving techniques are not time or cost efficient. With millions of digital images of the seafloor collected using remotely operated vehicles and autonomous underwater vehicles (AUVs), manual annotation of these data by marine experts is a tedious, repetitive, and time-consuming task. It takes 10–30 min for a marine expert to meticulously annotate a single image. Automated technology to monitor the health of the oceans would allow for transformational ecological outcomes by standardizing methods to detect and identify species. This paper aims to automate the analysis of large available AUV imagery by developing advanced deep learning tools for rapid and large-scale automatic annotation of marine coral species. Such an automated technology would greatly benefit marine ecological studies in terms of cost, speed, and accuracy. To this end, we propose a deep learning based classification method for coral reefs and report the application of the proposed technique to the automatic annotation of unlabeled mosaics of the coral reef in the Abrolhos Islands, W.A., Australia. Our proposed method automatically quantified the coral coverage in this region and detected a decreasing trend in coral population, which is in line with conclusions drawn by marine ecologists.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  R. Steneck,et al.  Coral Reefs Under Rapid Climate Change and Ocean Acidification , 2007, Science.

[3]  Robert B. Fisher,et al.  Coral classification with hybrid feature representations , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[4]  Rafael Garcia,et al.  Automated classification and thematic mapping of bacterial mats in the North Sea , 2013, 2013 MTS/IEEE OCEANS - Bergen.

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  O. Pizarro,et al.  Towards image-based marine habitat classification , 2008, OCEANS 2008.

[7]  Svetlana Lazebnik,et al.  Multi-scale Orderless Pooling of Deep Convolutional Activation Features , 2014, ECCV.

[8]  E. Barbier,et al.  Response to Comments on "Impacts of Biodiversity Loss on Ocean Ecosystem Services" , 2007, Science.

[9]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Robert B. Fisher,et al.  A research tool for long-term and continuous analysis of fish assemblage in coral-reefs using underwater camera footage , 2014, Ecol. Informatics.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Maricor Soriano,et al.  Classification of coral reef images from underwater video using neural networks. , 2005, Optics express.

[14]  R. Grosberg,et al.  Climate Change, Human Impacts, and the Resilience of Coral Reefs , 2003, Science.

[15]  Grant B. Deane,et al.  Automated processing of coral reef benthic images , 2009 .

[16]  Nancy Knowlton,et al.  Climate change impacts on marine ecosystems. , 2012, Annual review of marine science.

[17]  David J. Kriegman,et al.  Automated annotation of coral reef survey images , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[19]  Mohammed Bennamoun,et al.  A Discriminative Representation of Convolutional Features for Indoor Scene Recognition , 2015, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[20]  Mohammed Bennamoun,et al.  Resfeats: Residual network based features for image classification , 2016, 2017 IEEE International Conference on Image Processing (ICIP).

[21]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Oscar Beijbom,et al.  Improving Automated Annotation of Benthic Survey Images Using Wide-band Fluorescence , 2016, Scientific Reports.

[23]  Stefan B. Williams,et al.  Variable Responses of Benthic Communities to Anomalously Warm Sea Temperatures on a High-Latitude Coral Reef , 2014, PloS one.

[24]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[26]  Stefan B. Williams,et al.  Australian sea-floor survey data, with images and expert annotations , 2015, Scientific Data.

[27]  Stefan B. Williams,et al.  Monitoring of Benthic Reference Sites: Using an Autonomous Underwater Vehicle , 2012, IEEE Robotics & Automation Magazine.

[28]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.