Splash Detection in Fish Plants Surveillance Videos Using Deep Learning

The objective of this paper is to present and evaluate an improved method for automatic splash detection in surveillance videos of offshore fish production plants. In fishing and aquaculture industry one of the main challenges is production loss, that is, among the other things, caused by poor handling of the fish during operations such as crowding and delousing. This operations are very stressful for fish, and may trigger an increase in mortality, which is directly correlated with the production and profit loss. Because of this, improved solutions based on new technologies are being investigated, in order to decrease the risk of unnecessary stress, and improve the quality of production. One of the main parameters used for remote visual inspection of fish state is surface activity, which can be observed in a form of fish jumping and splashing. For that reason, in this paper, a novel algorithm based on using of Convolutional Neural Networks (CNNs) for splash detection is presented, which outperforms all existing algorithms based on local descriptors and linear classifiers. Using this approach we obtained splash detection accuracy of 99.9%.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  T. Dempster,et al.  Group Behavioural Responses of Atlantic Salmon (Salmo salar L.) to Light, Infrasound and Sound Stimuli , 2013, PloS one.

[3]  A. M. Sutterlin,et al.  Swimming Behavior of Salmonid Fish in Ocean Pens , 1979 .

[4]  Bing-Yu Chen,et al.  Video stabilization using robust feature trajectories , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  David W. Murray,et al.  Guided Sampling and Consensus for Motion Estimation , 2002, ECCV.

[6]  Daniel Berckmans,et al.  Precision fish farming: A new framework to improve production in aquaculture , 2017, Biosystems Engineering.

[7]  J. A. Alfredsen,et al.  Using acoustic telemetry to monitor the effects of crowding and delousing procedures on farmed Atlantic salmon (Salmo salar) , 2018, Aquaculture.

[8]  Annette Stahl,et al.  Splash detection in surveillance videos of offshore fish production plants , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).

[9]  Marie Poland Fish,et al.  SOUNDS OF WESTERN NORTH ATLANTIC FISHES. A REFERENCE FILE OF BIOLOGICAL UNDERWATER SOUNDS , 1970 .

[10]  Aníbal Ollero,et al.  Computer vision and robotics techniques in fish farms , 2003, Robotica.

[11]  Janusz Konrad,et al.  Probabilistic video stabilization using Kalman filtering and mosaicing , 2003, IS&T/SPIE Electronic Imaging.

[12]  A. Mcvicar,et al.  An exocrine pancreas disease of farmed Atlantic salmon in Scotland , 1984 .

[13]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[14]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[15]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Jon-Erik Juell,et al.  The behaviour of Atlantic salmon in relation to efficient cage-rearing , 1995, Reviews in Fish Biology and Fisheries.

[17]  T. Kristiansen,et al.  Technical note: Modifying Atlantic salmon (Salmo salar) jumping behavior to facilitate innovation of parasitic sea lice control techniques. , 2011, Journal of animal science.

[18]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[19]  Åsmund Bjordal,et al.  Surface activity of Atlantic salmon (Salmo salar L.) in net pens , 1993 .

[20]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).