Development of fish spatio-temporal identifying technology using SegNet in aquaculture net cages

Abstract In marine aquaculture, fish populations constantly decrease throughout the cultivation period because of mortality and escape. Current production management systems provide limited opportunities to count the cultured fish, making it difficult to estimate accurately the fish population in the cage. To overcome this problem, an automatic fish identifying method based on particle tracking velocimetry (PTV) flow visualization technology is proposed in this paper. The proposed method utilizes an image processing unit that extracts individual fish from the acquired image and a motion analysis unit that calculates the motion vector for each individual. Thus, the accuracy of the extraction results in the image processing unit affects the system’s counting results. To validate the efficiency and robustness of the image extraction performed by the image processing unit, individuals were extracted from images using the open-source image deep learning semantic segmentation method (SegNet), which is able to distinguish between the background and foreground in the images via analysis at the pixel level. SegNet is able to improve the image discrimination performance by multiplying the learning paths, and the robustness of the detection results can be ensured by changing the layer structure according to the detection target. Accordingly, the use of SegNet was evaluated in terms of the number of layers and images in the training set. The results of this study indicate that the application of SegNet with PTV technology represents a promising method for the automatic identifying and behavioral tracking of fish in an aquaculture net cage.

[1]  Pau Muñoz-Benavent,et al.  Automatic Bluefin Tuna sizing using a stereoscopic vision system , 2018 .

[2]  T. Takagi,et al.  Performance of a multi-stereovision technique to enhance the accuracy of fish body measurement for aquaculture management , 2019, NIPPON SUISAN GAKKAISHI.

[3]  Wei Shen,et al.  A method to estimate the abundance of fish based on dual-frequency identification sonar (DIDSON) imaging , 2017, Fisheries Science.

[4]  Simone Marini,et al.  Tracking Fish Abundance by Underwater Image Recognition , 2018, Scientific Reports.

[5]  Arto Kaarna,et al.  Fish Detection from Low Visibility Underwater Videos , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[6]  貴士 北川 クロマグロ Thunnus orientalis の行動生態と水温適応機構に関する研究 , 2008 .

[7]  Guijun Yang,et al.  A rapid, low-cost deep learning system to classify squid species and evaluate freshness based on digital images , 2020 .

[8]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Kohsei Takehara,et al.  DEVELOPMENT OF A NEW ALGORITHM FOR PTV , 1996 .

[10]  Valeria Caprettini,et al.  Live Intracellular Biorthogonal Imaging by Surface Enhanced Raman Spectroscopy using Alkyne-Silver Nanoparticles Clusters , 2018, Scientific Reports.

[11]  S. Masuma Development on techniques of stock enhancement for Pacific bluefin tuna Thunnus orientalis by the Fisheries Research Agency (formerly, Japan Sea Farming Association) , 2008 .

[12]  Daoliang Li,et al.  Nonintrusive methods for biomass estimation in aquaculture with emphasis on fish: a review , 2020, Reviews in Aquaculture.

[13]  Tsutomu Takagi,et al.  How many fish in a tank? Constructing an automated fish counting system by using PTV analysis , 2017, International Congress on High-Speed Imaging and Photonics.

[14]  Shigeru Miyashita,et al.  Completion of the Pacific bluefin tuna Thunnus orientalis (Temminck et Schlegel) life cycle , 2005 .

[15]  Michele Scardi,et al.  A dual camera system for counting and sizing northern bluefin tuna (Thunnus thynnus; Linnaeus, 1758) stock, during transfer to aquaculture cages, with a semi automatic Artificial Neural Network tool. , 2009 .

[16]  Khawar Khurshid,et al.  Automatic fish detection in underwater videos by a deep neural network-based hybrid motion learning system , 2019, ICES Journal of Marine Science.

[17]  Masaru Tanaka,et al.  Video Scene Detection of Burst Swimming by Fry of Farmed-raised Bluefin Tuna , 2018, 2018 4th International Conference on Frontiers of Signal Processing (ICFSP).

[18]  Mark R. Shortis,et al.  Camera Calibration Techniques for Accurate Measurement Underwater , 2019, 3D Recording and Interpretation for Maritime Archaeology.

[19]  Li Wang,et al.  Deep Learning for Practical Image Recognition: Case Study on Kaggle Competitions , 2018, KDD.

[20]  T. Takagi,et al.  Morphological features and functions of bluefin tuna change with growth , 2009, Fisheries Science.

[21]  Gary D. Melvin,et al.  Observations of in situ Atlantic bluefin tuna (Thunnus thynnus) with 500-kHz multibeam sonar , 2016 .

[22]  Faisal Shafait,et al.  Automated Fish Detection in Underwater Images Using Shape‐Based Level Sets , 2015 .

[23]  Daming Xu,et al.  Near-infrared imaging to quantify the feeding behavior of fish in aquaculture , 2017, Comput. Electron. Agric..

[24]  RosenShale,et al.  DeepVision: a stereo camera system provides highly accurate counts and lengths of fish passing inside a trawl , 2013 .