Time-unfolding Object Existence Detection in Low-quality Underwater Videos using Convolutional Neural Networks

Monitoring the environment for early recognition of changes is necessary for assessing the success of renaturation measures on a facts basis. It is also used in fisheries and livestock production for monitoring and for quality assurance. The goal of the presented system is to count sea trouts annually over the course of several months. Sea trouts are detected with underwater camera systems triggered by motion sensors. Such a scenario generates many videos that have to be evaluated manually. This article describes the techniques used to automate the image evaluation process. An effective method has been developed to classify videos and determine the times of occurrence of sea trouts, while significantly reducing the annotation effort. A convolutional neural network has been trained via supervised learning. The underlying images are frame compositions automatically extracted from videos on which sea trouts are to be detected. The accuracy of the resulting detection system reaches values of up to 97.7 %.

[1]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xiu Li,et al.  Fast accurate fish detection and recognition of underwater images with Fast R-CNN , 2015, OCEANS 2015 - MTS/IEEE Washington.

[3]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[4]  Marc Chaumont,et al.  Coral Reef Fish Detection and Recognition in Underwater Videos by Supervised Machine Learning: Comparison Between Deep Learning and HOG+SVM Methods , 2016, ACIVS.

[5]  A. Romakkaniemi,et al.  Salmon and sea trout populations and rivers in the Baltic Sea : HELCOM assessment of salmon (Salmo salar) and sea trout (Salmo trutta) populations and habitats in rivers flowing to the Baltic Sea , 2011 .

[6]  Faisal Shafait,et al.  Automated Fish Detection in Underwater Images Using Shape‐Based Level Sets , 2015 .

[7]  Andrew Rova,et al.  One Fish, Two Fish, Butterfish, Trumpeter: Recognizing Fish in Underwater Video , 2007, MVA.

[8]  Chen Feng,et al.  Fish recognition using convolutional neural network , 2017, OCEANS 2017 – Anchorage.

[9]  Li Deng,et al.  A deep convolutional neural network using heterogeneous pooling for trading acoustic invariance with phonetic confusion , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Phil F. Culverhouse,et al.  Fish identification from videos captured in uncontrolled underwater environments , 2016 .

[12]  Mark Fisher,et al.  Convolutional Neural Networks for Counting Fish in Fisheries Surveillance Video , 2015 .

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Son-Cheol Yu,et al.  Vision based real-time fish detection using convolutional neural network , 2017, OCEANS 2017 - Aberdeen.

[15]  Arto Kaarna,et al.  Fish Detection from Low Visibility Underwater Videos , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[16]  Robert B. Fisher,et al.  Detecting, Tracking and Counting Fish in Low Quality Unconstrained Underwater Videos , 2008, VISAPP.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[19]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[20]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  B. Adam,et al.  Fish Protection Technologies and Fish Ways for Downstream Migration , 2020 .

[23]  Sushant Jain,et al.  Underwater Fish Species Classification using Convolutional Neural Network and Deep Learning , 2017, 2017 Ninth International Conference on Advances in Pattern Recognition (ICAPR).