Intelligent Measurement of Morphological Characteristics of Fish Using Improved U-Net

In the smart mariculture, batch testing of breeding traits is a key issue in the breeding of improved fish varieties. The body length (BL), body width (BW) and body area (BA) features of fish are important indicators. They are of great significance in breeding, feeding and classification. To accurately and intelligently obtain the morphological characteristic sizes of fish in actual scenes, data augmentation is first used to greatly expand the published fish dataset, thereby ensuring the robustness of the training model. Then, an improved U-net segmentation and measurement algorithm is proposed, which uses a dilated convolution with a dilation rate 2 and a convolution to partially replace the convolution in the original U-net. This operation can enlarge the partial convolution receptive field and achieve more accurate segmentation for large targets in the scene. Finally, a line fitting method based on the least squares method is proposed, which is combined with the body shape features of fish and can accurately measure the BL and BW of inclined fish. Experimental results show that the Mean Intersection over Union (mIoU) is 97.6% and the average relative error of the area is 0.69%. Compared with the unimproved U-net, the average relative error of the area is reduced to about half. Moreover, with the improved U-net and the line fitting method, the average relative error of BL and the average relative error of BW of inclined fish decrease to 0.37% and 0.61%, respectively.

[1]  Antonio Torralba,et al.  LabelMe: Online Image Annotation and Applications , 2010, Proceedings of the IEEE.

[2]  C. Hsieh,et al.  Automatic measurement of the body length of harvested fish using convolutional neural networks , 2020, Biosystems Engineering.

[3]  Chuang Yu,et al.  Accurate Prediction Scheme of Water Quality in Smart Mariculture With Deep Bi-S-SRU Learning Network , 2020, IEEE Access.

[4]  Qingxiang Wu,et al.  Image super-resolution using a dilated convolutional neural network , 2018, Neurocomputing.

[5]  Yap-Peng Tan,et al.  Atrous convolutions spatial pyramid network for crowd counting and density estimation , 2019, Neurocomputing.

[6]  Yunming Ye,et al.  A multi-task learning model with adversarial data augmentation for classification of fine-grained images , 2020, Neurocomputing.

[7]  Juntao Liu,et al.  A Water Quality Prediction Method Based on the Deep LSTM Network Considering Correlation in Smart Mariculture , 2019, Sensors.

[8]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jalal A. Nasiri,et al.  KNN-based least squares twin support vector machine for pattern classification , 2018, Applied Intelligence.

[10]  Chuang Yu,et al.  Segmentation and measurement scheme for fish morphological features based on Mask R-CNN , 2020 .

[11]  Peter Jaksons,et al.  Validation of fish length estimations from a high frequency multi-beam sonar (ARIS) and its utilisation as a field-based measurement technique , 2019, Fisheries Research.

[12]  Daoliang Li,et al.  The Measurement of Fish Size by Machine Vision - A Review , 2015, CCTA.

[13]  Bin Yao,et al.  An efficient two-scan algorithm for computing basic shape features of objects in a binary image , 2016, Journal of Real-Time Image Processing.

[14]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[15]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[16]  Ayman Atia,et al.  YOLO fish detection with Euclidean tracking in fish farms , 2021, Journal of Ambient Intelligence and Humanized Computing.

[17]  Xiang Fan,et al.  A method overview in smart aquaculture , 2020, Environmental Monitoring and Assessment.

[18]  Qiuyu Zhu,et al.  Semi-supervised learning method based on predefined evenly-distributed class centroids , 2020, Applied Intelligence.

[19]  Yunpu Wu,et al.  A multi-perspective architecture for high-speed train fault diagnosis based on variational mode decomposition and enhanced multi-scale structure , 2019, Applied Intelligence.

[20]  Chengquan Zhou,et al.  Real-time nondestructive fish behavior detecting in mixed polyculture system using deep-learning and low-cost devices , 2021, Expert Syst. Appl..

[21]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ta-Chung Wang,et al.  An Improvement Stereo Vision Images Processing for Object Distance Measurement , 2015 .

[23]  Haibin Wu,et al.  Strain gauges position based on machine vision positioning , 2019, Integrated Ferroelectrics.

[24]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[25]  Alberto Assirelli,et al.  Semi-Automatic Guidance vs. Manual Guidance in Agriculture: A Comparison of Work Performance in Wheat Sowing , 2021, Electronics.

[26]  Daoliang Li,et al.  An improved KK-means clustering algorithm for fish image segmentation , 2013, Math. Comput. Model..

[27]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  S. Sepúlveda,et al.  Use and Adaptations of Machine Learning in Big Data—Applications in Real Cases in Agriculture , 2021, Electronics.

[29]  Daoliang Li,et al.  Recent Advances and Future Outlook for Artificial Intelligence in Aquaculture , 2020 .