Deep Learning Combined with Hyperspectral Imaging Technology for Variety Discrimination of Fritillaria thunbergii

Traditional Chinese herbal medicine (TCHM) plays an essential role in the international pharmaceutical industry due to its rich resources and unique curative properties. The flowers, stems, and leaves of Fritillaria contain a wide range of phytochemical compounds, including flavonoids, essential oils, saponins, and alkaloids, which may be useful for medicinal purposes. Fritillaria thunbergii Miq. Bulbs are commonly used in traditional Chinese medicine as expectorants and antitussives. In this paper, a feasibility study is presented that examines the use of hyperspectral imaging integrated with convolutional neural networks (CNN) to distinguish twelve (12) Fritillaria varieties (n = 360). The performance of support vector machines (SVM) and partial least squares-discriminant analysis (PLS-DA) was compared with that of convolutional neural network (CNN). Principal component analysis (PCA) was used to assess the presence of cluster trends in the spectral data. To optimize the performance of the models, cross-validation was used. Among all the discriminant models, CNN was the most accurate with 98.88%, 88.89% in training and test sets, followed by PLS-DA and SVM with 92.59%, 81.94% and 99.65%, 79.17%, respectively. The results obtained in the present study revealed that application of HSI in conjunction with the deep learning technique can be used for classification of Fritillaria thunbergii varieties rapidly and non-destructively.

[1]  Chu Zhang,et al.  Identification of Rice Seed Varieties Based on Near-Infrared Hyperspectral Imaging Technology Combined with Deep Learning , 2022, ACS omega.

[2]  M. R. Manikantan,et al.  Rapid detection of adulteration in desiccated coconut powder: vis-NIR spectroscopy and chemometric approach , 2022, Food Control.

[3]  Yong He,et al.  Hyperspectral imaging technology combined with deep learning for hybrid okra seed identification , 2021, Biosystems Engineering.

[4]  M. Kabir,et al.  Geographic Origin Discrimination of Millet Using Vis-NIR Spectroscopy Combined with Machine Learning Techniques , 2021, Foods.

[5]  Subir Kumar Chakraborty,et al.  Application of chemometrics to identify artificial ripening in sapota (Manilkara Zapota) using visible near infrared absorbance spectra , 2020, Comput. Electron. Agric..

[6]  D. Jayas,et al.  Non-destructive classification and prediction of aflatoxin-B1 concentration in maize kernels using Vis–NIR (400–1000 nm) hyperspectral imaging , 2020, Journal of Food Science and Technology.

[7]  Zhongwen Huang,et al.  A Rapid and Highly Efficient Method for the Identification of Soybean Seed Varieties: Hyperspectral Images Combined with Transfer Learning , 2019, Molecules.

[8]  Jinlong Zhang,et al.  Identification of Soybean Seed Varieties Based on Hyperspectral Imaging Technology , 2019, Sensors.

[9]  Pengcheng Nie,et al.  Classification of hybrid seeds using near-infrared hyperspectral imaging technology combined with deep learning , 2019, Sensors and Actuators B: Chemical.

[10]  Joon-Min Gil,et al.  Research paper classification systems based on TF-IDF and LDA schemes , 2019, Hum. centric Comput. Inf. Sci..

[11]  Cui Wu,et al.  Discrimination of Trichosanthis Fructus from Different Geographical Origins Using Near Infrared Spectroscopy Coupled with Chemometric Techniques , 2019, Molecules.

[12]  Chu Zhang,et al.  Discrimination of Chrysanthemum Varieties Using Hyperspectral Imaging Combined with a Deep Convolutional Neural Network , 2018, Molecules.

[13]  Hui Lin,et al.  Classification of Hyperspectral Images by Gabor Filtering Based Deep Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  M. Kim,et al.  Rapid assessment of corn seed viability using short wave infrared line-scan hyperspectral imaging and chemometrics , 2018 .

[15]  Chu Zhang,et al.  Identification of coffee bean varieties using hyperspectral imaging: influence of preprocessing methods and pixel-wise spectra analysis , 2018, Scientific Reports.

[16]  Chu Zhang,et al.  Variety Identification of Single Rice Seed Using Hyperspectral Imaging Combined with Convolutional Neural Network , 2018 .

[17]  Yong He,et al.  Application of hyperspectral imaging and chemometrics for variety classification of maize seeds , 2018, RSC advances.

[18]  Xuping Feng,et al.  Discrimination of CRISPR/Cas9-induced mutants of rice seeds using near-infrared hyperspectral imaging , 2017, Scientific Reports.

[19]  Chu Zhang,et al.  Determination and Visualization of Peimine and Peiminine Content in Fritillaria thunbergii Bulbi Treated by Sulfur Fumigation Using Hyperspectral Imaging with Chemometrics , 2017, Molecules.

[20]  Margarita Osadchy,et al.  Deep Convolutional Neural Networks for Raman Spectrum Recognition: A Unified Solution , 2017, The Analyst.

[21]  Chu Zhang,et al.  Application of near-infrared hyperspectral imaging to discriminate different geographical origins of Chinese wolfberries , 2017, PloS one.

[22]  M. Miranda,et al.  DETERMINATION OF BRACHIARIA SPP. FORAGE QUALITY BY NEAR-INFRARED SPECTROSCOPY AND PARTIAL LEAST SQUARES REGRESSION , 2017 .

[23]  Elena Marchiori,et al.  Convolutional neural networks for vibrational spectroscopic data analysis. , 2017, Analytica chimica acta.

[24]  Chu Zhang,et al.  Application of Near-Infrared Hyperspectral Imaging to Detect Sulfur Dioxide Residual in the Fritillaria thunbergii Bulbus Treated by Sulfur Fumigation , 2017 .

[25]  R. Galvão,et al.  Classification of individual cotton seeds with respect to variety using near-infrared hyperspectral imaging , 2016 .

[26]  Wei Zhao,et al.  Peimine, a main active ingredient of Fritillaria, exhibits anti-inflammatory and pain suppression properties at the cellular level. , 2016, Fitoterapia.

[27]  Lifu Zhang,et al.  Development of a Portable Field Imaging Spectrometer: Application for the Identification of Sun-Dried and Sulfur-Fumigated Chinese Herbals , 2016, Applied spectroscopy.

[28]  Gian Luca Foresti,et al.  Diversity-aware classifier ensemble selection via f-score , 2016, Inf. Fusion.

[29]  Rommel M. Barbosa,et al.  Recognition of organic rice samples based on trace elements and support vector machines , 2016 .

[30]  W. Foley,et al.  Near Infrared Spectroscopy in Wildlife and Biodiversity , 2016 .

[31]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[32]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[33]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[34]  Fang Cheng,et al.  Spectral and Image Integrated Analysis of Hyperspectral Data for Waxy Corn Seed Variety Classification , 2015, Sensors.

[35]  Mete Severcan,et al.  Differentiation of Anatolian honey samples from different botanical origins by ATR-FTIR spectroscopy using multivariate analysis. , 2015, Food chemistry.

[36]  Anthony J. Durkin,et al.  Review of short-wave infrared spectroscopy and imaging methods for biological tissue characterization , 2015, Journal of biomedical optics.

[37]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[38]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[39]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[40]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[41]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  R. Poppi,et al.  Classification of Amazonian rosewood essential oil by Raman spectroscopy and PLS-DA with reliability estimation. , 2013, Talanta.

[43]  D. Ballabio,et al.  Classification tools in chemistry. Part 1: linear models. PLS-DA , 2013 .

[44]  Chu Zhang,et al.  Rice Seed Cultivar Identification Using Near-Infrared Hyperspectral Imaging and Multivariate Data Analysis , 2013, Sensors.

[45]  Silvia Serranti,et al.  Classification of oat and groat kernels using NIR hyperspectral imaging. , 2013, Talanta.

[46]  Ricard Boqué,et al.  Rapid characterization of transgenic and non-transgenic soybean oils by chemometric methods using NIR spectroscopy. , 2013, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[47]  J. Blasco,et al.  Recent Advances and Applications of Hyperspectral Imaging for Fruit and Vegetable Quality Assessment , 2012, Food and Bioprocess Technology.

[48]  D. Cozzolino,et al.  Discrimination of meat paté s according to the animal species by means of near infrared spectroscopy and chemometrics , 2011 .

[49]  J. S. Ribeiro,et al.  Chemometric models for the quantitative descriptive sensory analysis of Arabica coffee beverages using near infrared spectroscopy. , 2011, Talanta.

[50]  Paul Geladi,et al.  Tracking diffusion of conditioning water in single wheat kernels of different hardnesses by near infrared hyperspectral imaging. , 2011, Analytica chimica acta.

[51]  Y R Chen,et al.  Two-dimensional visible/near-infrared correlation spectroscopy study of thawing behavior of frozen chicken meats without exposure to air. , 2001, Meat science.

[52]  J. C. BurgesChristopher.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998 .