Variety identi fi cation of oat seeds using hyperspectral imaging: investigating the representation ability of deep convolutional neural network

Variety identi fi cation of seeds is critical for assessing variety purity and ensuring crop yield. In this paper, a novel method based on hyperspectral imaging (HSI) and deep convolutional neural network (DCNN) was proposed to discriminate the varieties of oat seeds. The representation ability of DCNN was also investigated. The hyperspectral images with a spectral range of 874 – 1734 nm were primarily processed by principal component analysis (PCA) for exploratory visual distinguishing. Then a DCNN trained in an end-to-end manner was developed. The deep spectral features automatically learnt by DCNN were extracted and combined with traditional classi fi ers (logistic regression (LR), support vector machine with RBF kernel (RBF_SVM) and linear kernel (LINEAR_SVM)) to construct discriminant models. Contrast models were built based on the traditional classi fi ers using full wavelengths and optimal wavelengths selected by the second derivative (2nd derivative) method. The comparison results showed that all DCNN-based models outperformed the contrast models. DCNN trained in an end-to-end manner achieved the highest accuracy of 99.19% on the testing set, which was fi nally employed to visualize the variety classi fi cation. The results demonstrated that the deep spectral features with outstanding representation ability enabled HSI together with DCNN to be a reliable tool for rapid and accurate variety identi fi cation, which would help to develop an on-line system for quality detection of oat seeds as well as other grain seeds.

[1]  Bindu A Sunilkumar,et al.  Review of analytical methods for measurement of oat proteins: The need for standardized methods , 2019, Critical reviews in food science and nutrition.

[2]  Chu Zhang,et al.  Discrimination of Chrysanthemum Varieties Using Hyperspectral Imaging Combined with a Deep Convolutional Neural Network , 2018, Molecules.

[3]  Romà Tauler,et al.  Chemometrics in analytical chemistry—part II: modeling, validation, and applications , 2018, Analytical and Bioanalytical Chemistry.

[4]  P. Lasch,et al.  FT-IR Hyperspectral Imaging and Artificial Neural Network Analysis for Identification of Pathogenic Bacteria. , 2018, Analytical chemistry.

[5]  Jun Li,et al.  Active Learning With Convolutional Neural Networks for Hyperspectral Image Classification Using a New Bayesian Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Shuai Wang,et al.  Classifying Wheat Hyperspectral Pixels of Healthy Heads and Fusarium Head Blight Disease Using a Deep Neural Network in the Wild Field , 2018, Remote. Sens..

[7]  Chu Zhang,et al.  Identification of coffee bean varieties using hyperspectral imaging: influence of preprocessing methods and pixel-wise spectra analysis , 2018, Scientific Reports.

[8]  Huanda Lu,et al.  Deep-learning-based regression model and hyperspectral imaging for rapid detection of nitrogen concentration in oilseed rape (Brassica napus L.) leaf , 2018 .

[9]  Yun Shi,et al.  3D Convolutional Neural Networks for Crop Classification with Multi-Temporal Remote Sensing Images , 2018, Remote. Sens..

[10]  Yong He,et al.  Application of hyperspectral imaging and chemometrics for variety classification of maize seeds , 2018, RSC advances.

[11]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Xuping Feng,et al.  Discrimination of CRISPR/Cas9-induced mutants of rice seeds using near-infrared hyperspectral imaging , 2017, Scientific Reports.

[14]  M. Kim,et al.  Non-destructive evaluation of bacteria-infected watermelon seeds using visible/near-infrared hyperspectral imaging. , 2016, Journal of the science of food and agriculture.

[15]  Lisa J. Martin,et al.  Newly developed and validated eosinophilic esophagitis histology scoring system and evidence that it outperforms peak eosinophil count for disease diagnosis and monitoring. , 2016, Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus.

[16]  Santosh Lohumi,et al.  Near-infrared hyperspectral imaging system coupled with multivariate methods to predict viability and vigor in muskmelon seeds , 2016 .

[17]  W. Foley,et al.  Near Infrared Spectroscopy in Wildlife and Biodiversity , 2016 .

[18]  Chu Zhang,et al.  Application of Near-Infrared Hyperspectral Imaging with Variable Selection Methods to Determine and Visualize Caffeine Content of Coffee Beans , 2016, Food and Bioprocess Technology.

[19]  Chu Zhang,et al.  Rice Seed Cultivar Identification Using Near-Infrared Hyperspectral Imaging and Multivariate Data Analysis , 2013, Sensors.

[20]  Yan Wang,et al.  Genetic purity testing of F1 hybrid seed with molecular markers in cabbage (Brassica oleracea var. capitata) , 2013 .

[21]  Silvia Serranti,et al.  Classification of oat and groat kernels using NIR hyperspectral imaging. , 2013, Talanta.

[22]  J. S. Ribeiro,et al.  Chemometric models for the quantitative descriptive sensory analysis of Arabica coffee beverages using near infrared spectroscopy. , 2011, Talanta.

[23]  D Cozzolino,et al.  Identification of transgenic foods using NIR spectroscopy: a review. , 2010, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[24]  T. Sontag-Strohm,et al.  Viscosity of beta-glucan in oat products , 2008 .

[25]  M Daszykowski,et al.  Near-infrared reflectance spectroscopy and multivariate calibration techniques applied to modelling the crude protein, fibre and fat content in rapeseed meal. , 2008, The Analyst.

[26]  Taufiq Ahmad,et al.  Characterization of wheat varieties by seed storageprotein electrophoresis , 2007 .

[27]  A. Krizhevsky ImageNet Classification with Deep Convolutional Neural Networks , 2022 .