Classification of Shellfish Recognition Based on Improved Faster R-CNN Framework of Deep Learning

In view of the current absence of any deep learning algorithm for shellfish identification in real contexts, an improved Faster R-CNN-based detection algorithm is proposed in this paper. It achieves multiobject recognition and localization through a second-order detection network and replaces the original feature extraction module with DenseNet, which can fuse multilevel feature information, increase network depth, and avoid the disappearance of network gradients. Meanwhile, the proposal merging strategy is improved with Soft-NMS, where an attenuation function is designed to replace the conventional NMS algorithm, thereby avoiding missed detection of adjacent or overlapping objects and enhancing the network detection accuracy under multiple objects. By constructing a real contexts shellfish dataset and conducting experimental tests on a vision recognition seafood sorting robot production line, we were able to detect the features of shellfish in different scenarios, and the detection accuracy was improved by nearly 4% compared to the original detection model, achieving a better detection accuracy. This provides favorable technical support for future quality sorting of seafood using the improved Faster R-CNN-based approach.

[1]  X.Y. Long,et al.  Deep learning-based planar crack damage evaluation using convolutional neural networks , 2021, Engineering Fracture Mechanics.

[2]  Xu Zhang,et al.  Integration of Artificial Neural Network Modeling and Hyperspectral Data Preprocessing for Discrimination of Colla Corii Asini Adulteration , 2018 .

[3]  Laijun Sun,et al.  Pixel based bruise region extraction of apple using Vis-NIR hyperspectral imaging , 2018, Comput. Electron. Agric..

[4]  Matthias Baumgarten,et al.  Optimal model selection for posture recognition in home-based healthcare , 2011, Int. J. Mach. Learn. Cybern..

[5]  Jiahui Liu,et al.  Multipath feature recalibration DenseNet for image classification , 2020, International Journal of Machine Learning and Cybernetics.

[6]  Guangfeng Lin,et al.  Fusion of 2D CNN and 3D DenseNet for Dynamic Gesture Recognition , 2019, Electronics.

[7]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[8]  Tao Zhang,et al.  Nondestructive Identification of Salmon Adulteration with Water Based on Hyperspectral Data , 2018, Journal of Food Quality.

[9]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Amctb No,et al.  z-Scores and other scores in chemical proficiency testing-their meanings, and some common misconceptions. , 2016, Analytical methods : advancing methods and applications.

[13]  Yoshio Makino,et al.  Rapid and non-destructive detection of chicken adulteration in minced beef using visible near-infrared hyperspectral imaging and machine learning , 2016 .

[14]  Miguel Peris,et al.  Electronic noses and tongues to assess food authenticity and adulteration , 2016 .

[15]  Nan Mo,et al.  Improved Faster RCNN Based on Feature Amplification and Oversampling Data Augmentation for Oriented Vehicle Detection in Aerial Images , 2020, Remote. Sens..

[16]  Qiang Liu,et al.  Coverless image steganography based on DenseNet feature mapping , 2020, EURASIP Journal on Image and Video Processing.

[17]  Yunhong Liu,et al.  Non-destructive detection of Flos Lonicerae treated by sulfur fumigation based on hyperspectral imaging , 2018, Journal of Food Measurement and Characterization.

[18]  B. Lovell,et al.  Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNN , 2020, Pattern Recognit. Lett..

[19]  J. Cross,et al.  Application of hyperspectral imaging for nondestructive measurement of plum quality attributes , 2018, Postharvest Biology and Technology.

[20]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[21]  Syed Ghulam Musharraf,et al.  Application of analytical methods in authentication and adulteration of honey. , 2017, Food chemistry.

[22]  Min Huang,et al.  Quantitative analysis of melamine in milk powders using near-infrared hyperspectral imaging and band ratio , 2016 .

[23]  Yuan Zhou,et al.  Image super-resolution based on dense convolutional auto-encoder blocks , 2021, Neurocomputing.

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Arne Elofsson,et al.  Protein Contact Map Prediction Based on ResNet and DenseNet , 2020, BioMed research international.

[26]  K. Tu,et al.  Identification of Bruise and Fungi Contamination in Strawberries Using Hyperspectral Imaging Technology and Multivariate Analysis , 2018, Food Analytical Methods.

[27]  Analytical Methods Committee Amctb No z-Scores and other scores in chemical proficiency testing-their meanings, and some common misconceptions. , 2016, Analytical Methods.

[28]  Jia-Xu Dong,et al.  Abalone Muscle Texture Evaluation and Prediction Based on TPA Experiment , 2017 .

[29]  Kai Yang,et al.  A Semantics-Guided Graph Convolutional Network for Skeleton-Based Action Recognition , 2020, ICIAI.

[30]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[31]  Wen Chen,et al.  Characterization of elastic parameters for functionally graded material by a meshfree method combined with the NMS approach , 2018 .

[32]  Siwa Msangi,et al.  Fish to 2030: The Role and Opportunity for Aquaculture , 2015 .

[33]  Hongbin Pu,et al.  Spectral absorption index in hyperspectral image analysis for predicting moisture contents in pork longissimus dorsi muscles. , 2016, Food chemistry.

[34]  Francesca Antonucci,et al.  Automated sorting for size, sex and skeletal anomalies of cultured seabass using external shape analysis , 2013 .

[35]  Zhigang Liu,et al.  Detection Approach Based on an Improved Faster RCNN for Brace Sleeve Screws in High-Speed Railways , 2020, IEEE Transactions on Instrumentation and Measurement.