A Deep Learning-based Framework for the Detection of Schools of Herring in Echograms

Tracking the abundance of underwater species is crucial for understanding the effects of climate change on marine ecosystems. Biologists typically monitor underwater sites with echosounders and visualize data as 2D images (echograms); they interpret these data manually or semi-automatically, which is time-consuming and prone to inconsistencies. This paper proposes a deep learning framework for the automatic detection of schools of herring from echograms. Experiments demonstrated that our approach outperforms a traditional machine learning algorithm using hand-crafted features. Our framework could easily be expanded to detect more species of interest to sustainable fisheries.

[1]  S. Gauthier,et al.  Species composition and acoustic signatures of mesopelagic organisms in a subtropical convergence zone, the New Zealand Chatham Rise , 2014 .

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[5]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  H. Kawamura,et al.  Discriminating fish species by an Echo sounder in a set-net using a CNN , 2017, 2017 21st Asia Pacific Symposium on Intelligent and Evolutionary Systems (IES).

[8]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[9]  T. Stanton.  30 years of advances in active bioacoustics: A personal perspective , 2012 .

[10]  Ariel G. Cabreira,et al.  Artificial neural networks for fish-species identification , 2009 .

[11]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[12]  M. Trevorrow,et al.  The use of moored inverted echo sounders for monitoring meso-zooplankton and fish near the ocean surface , 2005 .

[13]  Mark Fisher,et al.  JellyMonitor: automated detection of jellyfish in sonar images using neural networks , 2018, 2018 14th IEEE International Conference on Signal Processing (ICSP).

[14]  Zhiguo Cao,et al.  Counting Fish in Sonar Images , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[15]  Derek Bradley,et al.  Adaptive Thresholding using the Integral Image , 2007, J. Graph. Tools.

[16]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Paul G. Fernandes,et al.  Classification of Southern Ocean krill and icefish echoes using random forests , 2016 .

[18]  Jianlong Li,et al.  Study on Echo Features and Classification Methods of Fish Species , 2018, 2018 10th International Conference on Wireless Communications and Signal Processing (WCSP).

[19]  Inmaculada Pulido-Calvo,et al.  Acoustic identification of small pelagic fish species in Chile using support vector machines and neural networks , 2010 .

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Rodney D. Hale,et al.  Acoustic species identification in the Northwest Atlantic using digital image processing , 2000 .

[22]  Ichiro Aoki,et al.  Classification of fish schools based on evaluation of acoustic descriptor characteristics , 2009, Fisheries Science.

[23]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[24]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Juho Mäkiö,et al.  A Joint Application of Fuzzy Logic Approximation and a Deep Learning Neural Network to Build Fish Concentration Maps Based on Sonar Data , 2019, CMIS.

[26]  D. Lemon,et al.  Multiple-frequency moored sonar for continuous observations of zooplankton and fish , 2012, 2012 Oceans.