Real-time robust detector for underwater live crabs based on deep learning

Abstract Image analysis technology has drawn dramatic attention and developed rapidly because it enables a non-extractive and non-destructive approach to data acquisition of crab aquaculture. Owing to the irregular shape, multi-scale posture and special underwater environment, it is very challenging to adopt the traditional image recognition methods to detect crabs quickly and effectively. Consequently, we propose a real-time and robust object detector, Faster MSSDLite, for detecting underwater live crabs. Lightweight MobileNetV2 is selected as the backbone of a single shot multi-box detector (SSD), and standard convolution is replaced by depthwise separable convolution in the prediction layers. A feature pyramid network (FPN) is adopted at low extra cost to improve the detection precision of multi-scale crabs and make up for the deficiency of SSD to force different network layers to learn the same features. More significantly, the unified quantized convolutional neural network (Quantized-CNN) framework is applied to quantify the error correction of the improved detector for further accelerating the computation of convolutional layers and compressing the parameters of fully-connected layers. The test results show that Faster MSSDLite has better performance than traditional SSD. The average precision (AP) and F1 score of detection are 99.01% and 98.94%, respectively. The detection speed can reach 74.07 frames per second in commonly configured microcomputers (~8× faster than SSD). The computation amount of floating-point numbers required by the detection is reduced to only 0.32 billion (~49× smaller than SSD), and the size of the model is compressed into 4.84 MB (~28× smaller than SSD). The model is also more robust, which can stably detect underwater live crabs in real-time, estimate the live crab biomass in water bodies automatically, and provide reliable feedback information for the fine feeding of automatic feeding boats.

[1]  Ahmad Salman,et al.  Real-time fish detection in complex backgrounds using probabilistic background modelling , 2019, Ecol. Informatics.

[2]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Xiaoyang Liu,et al.  A new optimization particle filtering navigation location method for aquatic plants cleaning workboat in crab farming , 2018, International Journal of Advanced Robotic Systems.

[4]  Yi Wang,et al.  Real-time forest smoke detection using hand-designed features and deep learning , 2019, Comput. Electron. Agric..

[5]  Lihong Xu,et al.  Detection of uneaten fish food pellets in underwater images for aquaculture , 2017 .

[6]  Dean Zhao,et al.  Robust model predictive control of the automatic operation boats for aquaculture , 2017, Comput. Electron. Agric..

[7]  Jenq-Neng Hwang,et al.  Multi-Scale Fish Segmentation Refinement and Missing Shape Recovery , 2019, IEEE Access.

[8]  Dumitru Erhan,et al.  Scalable Object Detection Using Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Neeraj Kumar,et al.  Enacting Segmentation Algorithms for Classifying Fish Species , 2017 .

[10]  Miaomiao Chen,et al.  An intelligent IoT-based control and traceability system to forecast and maintain water quality in freshwater fish farms , 2019, Comput. Electron. Agric..

[11]  Xiaolin Zhu,et al.  Automatic detection of individual oil palm trees from UAV images using HOG features and an SVM classifier , 2018, International Journal of Remote Sensing.

[12]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Fernando Daniel Von Borstel Luna,et al.  Robotic System for Automation of Water Quality Monitoring and Feeding in Aquaculture Shadehouse , 2017, IEEE Trans. Syst. Man Cybern. Syst..

[14]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jian Cheng,et al.  Quantized Convolutional Neural Networks for Mobile Devices , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Amelia Carolina Sparavigna.  Retinex filtering and thresholding of foggy images , 2015 .

[18]  Kuldeep Singh,et al.  Contrast enhancement via texture region based histogram equalization , 2016 .

[19]  Hao Zhou,et al.  Faster R-CNN for marine organisms detection and recognition using data augmentation , 2019, Neurocomputing.

[20]  Daoliang Li,et al.  An automatic active contour method for sea cucumber segmentation in natural underwater environments , 2017, Comput. Electron. Agric..

[21]  Daoliang Li,et al.  fvUnderwater sea cucumber identification based on Principal Component Analysis and Support Vector Machine , 2019, Measurement.

[22]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  S. Indu,et al.  Fish Species Classification Using Graph Embedding Discriminant Analysis , 2017, 2017 International Conference on Machine Vision and Information Technology (CMVIT).

[25]  Syed Jawad Hussain Shah,et al.  Visual features based automated identification of fish species using deep convolutional neural networks , 2019, Comput. Electron. Agric..

[26]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Tamaki Ura,et al.  Erratum to: Enhancement of deep-sea floor images obtained by an underwater vehicle and its evaluation by crab recognition , 2017 .

[28]  Sudipta Rudra,et al.  A Novel Approach of K-SVD-Based Algorithm for Image Denoising , 2019 .

[29]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Ji Luo,et al.  Design and testing of a control system associated with the automatic feeding boat for farming Chinese river crabs , 2018, Comput. Electron. Agric..