Deep learning-based appearance features extraction for automated carp species identification

Abstract Fish species identification is vital for aquaculture and fishery industries, stock management of water bodies and environmental monitoring of aquatics. Traditional fish species identification approaches are costly, time consuming, expert-based and unsuitable for large-scale applications. Hence, in this study, a deep learning neural network as a smart, real-time and non-destructive method was developed and applied to automate the identification of four economically important carp species namely common carp (Cyprinus carpio), grass carp (Ctenopharingodon idella), bighead carp (Hypophtalmichthys nobilis) and silver carp (Hypophthalmichthys molitrix). The obtained results proved that our approach, evaluated through 5-fold cross-validation, achieved the highest possible accuracy of 100 %. The achieved high level of classification accuracy was due to the ability of the suggested deep model to build a hierarchy of self-learned features, which was in accordance with the hierarchy of these fish’s identification keys. In conclusion, the proposed convolutional neural network (CNN)-based method has a single and generic trained architecture with promising performance for fish species identification.

[1]  Daoliang Li,et al.  Fish species classification by color, texture and multi-class support vector machine using computer vision , 2012 .

[2]  U. Rajendra Acharya,et al.  Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network , 2017, Inf. Sci..

[3]  Kwok-Wing Chau,et al.  A Survey of Deep Learning Techniques: Application in Wind and Solar Energy Resources , 2019, IEEE Access.

[4]  H. Sebastian Seung,et al.  Permitted and Forbidden Sets in Symmetric Threshold-Linear Networks , 2003, Neural Computation.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[7]  Chang-Su Kim,et al.  Background subtraction using encoder-decoder structured convolutional neural network , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[8]  Rasmus Larsen,et al.  Shape and Texture Based Classification of Fish Species , 2009, SCIA.

[9]  Yakup Kutlu,et al.  Image analysis methods on fish recognition , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[10]  Mostafa Mehdipour-Ghazi,et al.  Plant identification using deep neural networks via optimization of transfer learning parameters , 2017, Neurocomputing.

[11]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[12]  B. Dayrat,et al.  Towards integrative taxonomy , 2005 .

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Aydin Kaya,et al.  Analysis of transfer learning for deep neural network based plant classification models , 2019, Comput. Electron. Agric..

[15]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[16]  Jayme Garcia Arnal Barbedo,et al.  Plant disease identification from individual lesions and spots using deep learning , 2019, Biosystems Engineering.

[17]  Nils Olav Handegard,et al.  Fish species identification using a convolutional neural network trained on synthetic data , 2018, ICES Journal of Marine Science.

[18]  Nour Eldeen M. Khalifa,et al.  Aquarium Family Fish Species Identification System Using Deep Neural Networks , 2018, AISI.

[19]  Aboul Ella Hassanien,et al.  A biometric-based model for fish species classification , 2018 .

[20]  Margaret Kosmala,et al.  Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning , 2017, Proceedings of the National Academy of Sciences.

[21]  Giovanni Maria Carlomagno,et al.  An intelligent approach for cooling radiator fault diagnosis based on infrared thermal image processing technique , 2015 .

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[24]  Robert B. Fisher,et al.  Automatic fish classification for underwater species behavior understanding , 2010, ARTEMIS '10.

[25]  Lian Li,et al.  Identification of fish species based on image processing and statistical analysis research , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[26]  Dah-Jye Lee,et al.  Contour matching for a fish recognition and migration-monitoring system , 2004, SPIE Optics East.

[27]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[28]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[29]  Santosh Kumar,et al.  Face Recognition of Cattle: Can it be Done? , 2016, Proceedings of the National Academy of Sciences, India Section A: Physical Sciences.

[30]  Andrew Rova,et al.  One Fish, Two Fish, Butterfish, Trumpeter: Recognizing Fish in Underwater Video , 2007, MVA.

[31]  Alessandro Rizzi,et al.  Underwater color constancy: enhancement of automatic live fish recognition , 2003, IS&T/SPIE Electronic Imaging.

[32]  A. Muñoz-serrano,et al.  DNA microsatellites to ascertain pedigree-recorded information in a selecting nucleus of Murciano-Granadina dairy goats , 2006 .

[33]  Bin Liu,et al.  Weld Defect Images Classification with VGG16-Based Neural Network , 2017, IFTC.

[34]  Alexander Loos,et al.  Identification of great apes using face recognition , 2011, 2011 19th European Signal Processing Conference.

[35]  Andrés Hernández-Serna,et al.  Automatic identification of species with neural networks , 2014, PeerJ.

[36]  Václav Snásel,et al.  Biometric cattle identification approach based on Weber's Local Descriptor and AdaBoost classifier , 2016, Comput. Electron. Agric..

[37]  Frank Storbeck,et al.  Fish species recognition using computer vision and a neural network , 2001 .

[38]  Tristan Perez,et al.  DeepFruits: A Fruit Detection System Using Deep Neural Networks , 2016, Sensors.

[39]  Huaizu Jiang,et al.  Face Detection with the Faster R-CNN , 2016, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[40]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[41]  Yudong Zhang,et al.  Image-based deep learning automated sorting of date fruit , 2019, Postharvest Biology and Technology.

[42]  Pablo M. Granitto,et al.  Deep learning for plant identification using vein morphological patterns , 2016, Comput. Electron. Agric..