A data fusion detection method for fish freshness based on computer vision and near-infrared spectroscopy

Freshness is one of the most significant parameters of fish quality. This study aims to develop a new rapid non-destructive technique to assess fish freshness. Two different technologies including computer vision and near-infrared spectroscopy (NIR spectroscopy) were employed in the detection. Subsequently a new data fusion detection method was developed to improve the accuracy of classification by combining the inspection data of computer vision with that of NIR spectroscopy. Parabramis pekinensis bought from a local market were taken as experimental samples. The total volatile basic nitrogen (TVB-N) content of the samples was measured as an indicator of fish freshness using conventional methods. Computer vision and NIR spectroscopy were used to acquire image information for organoleptic changes and spectrum information for structural changes in the fish samples during storage, respectively. Principal component analysis (PCA) was used for data compression to reduce the dimensionality of the data set while essential information was retained, which made the analysis easier than it would have been for the original huge data set. A back propagation artificial neural network (BP-ANN) was used to build a prediction model by obtaining a non-linear relation between the fish freshness and the body changes during storage. The results showed that computer vision technology outperformed NIR spectroscopy techniques, for the BP-ANN model reached a 94.17% success rate in the training set and 90.00% in the prediction set using the computer vision technology, while the model of NIR spectroscopy reached 86.67% and 80.00% in the training set and prediction set respectively. This showed improved fish freshness classification using computer vision technology rather than the NIR spectroscopic method. Therefore, the data from the two techniques were considered simultaneously, using the classification model BP-ANN, which achieves the optimum performance of 96.67% and 93.33% corresponding to the training set and prediction set respectively using data fusion. Therefore, this demonstrated for the first time the feasibility and superiority of data fusion by integrating computer vision and NIR spectroscopy in the classification of fish freshness.

[1]  Tormod Næs,et al.  Related versions of the multiplicative scatter correction method for preprocessing spectroscopic data , 1995 .

[2]  M. Plascencia-Jatomea,et al.  Freshness assessment of ray fish stored in ice by biochemical, chemical and physical methods , 2011 .

[3]  Liju Yang,et al.  Amperometric determination of fish freshness by a hypoxanthine biosensor , 1996 .

[4]  Seoung Bum Kim,et al.  An effective classification procedure for diagnosis of prostate cancer in near infrared spectra , 2010, Expert Syst. Appl..

[5]  Boaz Zion,et al.  Review: The use of computer vision technologies in aquaculture - A review , 2012 .

[6]  John Reidar Mathiassen,et al.  Trends in application of imaging technologies to inspection of fish and fish products , 2011 .

[7]  Seyed Saeid Mohtasebi,et al.  Application of machine-vision techniques to fish-quality assessment , 2012 .

[8]  E Misimi,et al.  Computer vision-based sorting of Atlantic salmon (Salmo salar) fillets according to their color level. , 2007, Journal of food science.

[9]  Thierry Denoeux,et al.  Principal component analysis of fuzzy data using autoassociative neural networks , 2004, IEEE Transactions on Fuzzy Systems.

[10]  P. Geladi,et al.  Linearization and Scatter-Correction for Near-Infrared Reflectance Spectra of Meat , 1985 .

[11]  H. Allan Bremner,et al.  A Critical Look at Whether ‘Freshness’ Can Be Determined , 2000 .

[12]  Baohua Zhang,et al.  Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review , 2014 .

[13]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[14]  Hiroaki Suzuki,et al.  Droplet-based microfluidic sensing system for rapid fish freshness determination , 2012 .

[15]  R. Lu,et al.  Comparison and fusion of four nondestructive sensors for predicting apple fruit firmness and soluble solids content , 2012 .

[16]  Di Wu,et al.  Colour measurements by computer vision for food quality control – A review , 2013 .

[17]  Jean-François Mas,et al.  Mapping land use/cover in a tropical coastal area using satellite sensor data, GIS and artificial neural networks , 2004 .

[18]  Mohamad Awad,et al.  Sea water chlorophyll-a estimation using hyperspectral images and supervised Artificial Neural Network , 2014, Ecol. Informatics.

[19]  Paw Dalgaard,et al.  Methods to evaluate fish freshness in research and industry , 1997 .

[20]  Jiewen Zhao,et al.  Nondestructive measurement of total volatile basic nitrogen (TVB-N) in pork meat by integrating near infrared spectroscopy, computer vision and electronic nose techniques. , 2014, Food chemistry.

[21]  J. Aguilera,et al.  Computer Vision and Stereoscopy for Estimating Firmness in the Salmon (Salmon salar) Fillets , 2010 .

[22]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[23]  R. Mehra,et al.  Analysis of PCA based compression and denoising of smart grid data under normal and fault conditions , 2013, 2013 IEEE International Conference on Electronics, Computing and Communication Technologies.

[24]  Fereidoon Shahidi,et al.  Comparative quality assessment of cultured and wild sea bream (Sparus aurata) stored in ice. , 2002, Journal of agricultural and food chemistry.

[25]  Fereidoon Shahidi,et al.  Freshness quality of harp seal (Phoca groenlandica) meat , 1994 .