Smart deep learning-based approach for non-destructive freshness diagnosis of common carp fish

Abstract Assessment and intelligent monitoring of fish freshness are of the utmost importance in yield and trade of fishery products. Rapid and precise assessment of fish freshness using conventional methods considering the great volume of industrial production is challenging. In this study, instead of feature-engineering-based methods, a novel and accurate fish freshness detection is proposed based on the images obtained from common carp and by applying a deep convolutional neural network (CNN). To classify fish images based on freshness by the proposed approach, first, VGG-16 architecture was applied to extract features from fish images automatically. Then, a developed classifier block constructed by dropout and dense layers was utilized to classify fish images. The obtained results showed the classification accuracy of 98.21%, and in conclusion, the proposed CNN-based method has lower complexity with higher accuracy compared to traditional classification methods. This method is well-capable of monitoring and classifying fish freshness as a fast, low-cost, precise, non-destructive, real-time and automated technique.

[1]  Franco Pedreschi,et al.  Color of Salmon Fillets By Computer Vision and Sensory Panel , 2010 .

[2]  Ali Selamat,et al.  Breast Cancer Detection Using Infrared Thermal Imaging and a Deep Learning Model , 2018, Sensors.

[3]  Tristan Perez,et al.  DeepFruits: A Fruit Detection System Using Deep Neural Networks , 2016, Sensors.

[4]  Da-Wen Sun,et al.  Computer Vision Detection of Salmon Muscle Gaping Using Convolutional Neural Network Features , 2017, Food Analytical Methods.

[5]  Amin Taheri-Garavand,et al.  Real-time nondestructive monitoring of Common Carp Fish freshness using robust vision-based intelligent modeling approaches , 2019, Comput. Electron. Agric..

[6]  Chunli Kong,et al.  The role of microorganisms in the degradation of adenosine triphosphate (ATP) in chill-stored common carp (Cyprinus carpio) fillets. , 2017, Food chemistry.

[7]  M. Gassem Microbiological and chemical quality of a traditional salted-fermented fish (Hout-Kasef) product of Jazan Region, Saudi Arabia. , 2019, Saudi journal of biological sciences.

[8]  J. Fernandez-Piquer,et al.  Sensory, Microbiological and Chemical Changes in Vacuum‐Packaged Blue Spotted Emperor (Lethrinus sp), Saddletail Snapper (Lutjanus malabaricus), Crimson Snapper (Lutjanus erythropterus), Barramundi (Lates calcarifer) and Atlantic Salmon (Salmo salar) Fillets Stored at 4°C , 2015, Food science & nutrition.

[9]  Geok Soon Hong,et al.  Defect detection in selective laser melting technology by acoustic signals with deep belief networks , 2018, The International Journal of Advanced Manufacturing Technology.

[10]  Xichang Wang,et al.  High‐speed display‐delayed planar X‐ray inspection system for the fast detection of small fishbones , 2019, Journal of Food Process Engineering.

[11]  Yudong Zhang,et al.  Image-based deep learning automated sorting of date fruit , 2019, Postharvest Biology and Technology.

[12]  Barbara A. Block,et al.  Tracking the global footprint of fisheries , 2018, Science.

[13]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[16]  Edward Sazonov,et al.  Feature Extraction Using Deep Learning for Food Type Recognition , 2017, IWBBIO.

[17]  Yu-Ru Huang,et al.  Changes in Biochemical Compositions and Quality of White Shrimp (Litopenaeus vannamei) During Storage , 2016 .

[18]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[19]  Giovanni Maria Carlomagno,et al.  An intelligent approach for cooling radiator fault diagnosis based on infrared thermal image processing technique , 2015 .

[20]  Yifeng Li,et al.  Personalized prediction of genes with tumor-causing somatic mutations based on multi-modal deep Boltzmann machine , 2019, Neurocomputing.

[21]  Bin Li,et al.  Early Fault Detection of Machine Tools Based on Deep Learning and Dynamic Identification , 2019, IEEE Transactions on Industrial Electronics.

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Haidong Shao,et al.  A novel method for intelligent fault diagnosis of rolling bearings using ensemble deep auto-encoders , 2018 .

[25]  Xiaojun Jia,et al.  Study of shrimp recognition methods using smart networks , 2019, Comput. Electron. Agric..

[26]  Da-Wen Sun,et al.  Inspection and grading of agricultural and food products by computer vision systems—a review , 2002 .

[27]  Mostafa Mehdipour-Ghazi,et al.  Plant identification using deep neural networks via optimization of transfer learning parameters , 2017, Neurocomputing.

[28]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[29]  Jianrong Li,et al.  Freshness assessment of turbot (Scophthalmus maximus) by Quality Index Method (QIM), biochemical, and proteomic methods , 2017 .

[30]  Mahmoud Omid,et al.  Meat quality evaluation based on computer vision technique: A review. , 2019, Meat science.

[31]  M. I. Yeannes,et al.  Development of Quality Index Method Scheme for Common Carp (Cyprinus carpio) Stored in Ice: Shelf-Life Assessment by Physicochemical, Microbiological, and Sensory Quality Indices , 2016 .

[32]  J. Aguilera,et al.  Computer Vision and Stereoscopy for Estimating Firmness in the Salmon (Salmon salar) Fillets , 2010 .

[33]  Ajmal Mian,et al.  Fish species classification in unconstrained underwater environments based on deep learning , 2016 .

[34]  Zihao Liu Soft-shell Shrimp Recognition Based on an Improved AlexNet for Quality Evaluations , 2020 .

[35]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[36]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Henrik Skov Midtiby,et al.  Plant species classification using deep convolutional neural network , 2016 .

[38]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[39]  Darko Stefanovic,et al.  Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification , 2016, Comput. Intell. Neurosci..

[40]  E Misimi,et al.  Computer vision-based evaluation of pre- and postrigor changes in size and shape of Atlantic cod (Gadus morhua) and Atlantic salmon (Salmo salar) fillets during rigor mortis and ice storage: effects of perimortem handling stress. , 2008, Journal of food science.

[41]  Juan Zhou,et al.  An improved nondestructive measurement method for salmon freshness based on spectral and image information fusion , 2019, Comput. Electron. Agric..

[42]  Maryam Rahnemoonfar,et al.  Deep Count: Fruit Counting Based on Deep Simulated Learning , 2017, Sensors.

[43]  Wallace Marshall,et al.  Deep Convolutional and Recurrent Neural Networks for Cell Motility Discrimination and Prediction , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[44]  Yuthana Phimolsiripol,et al.  Kinetics and Nondestructive Measurement of Total Volatile Basic Nitrogen and Thiobarbituric Acid-Reactive Substances in Chilled Tabtim Fish Fillets Using Near Infrared Spectroscopy (NIRS) , 2016 .

[45]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[46]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .