Hyperspectral Image Classification for Foreign Bodies in Medicine Based on Spatial-Spectral Fusion Feature

As the cornerstone of the pharmaceutical industry and the important guarantee for people’s health, pharmaceutical safety has attracted more and more attention from both inside and outside the industry, in which the detection of foreign bodies has always been an important link. In view of the advantages of hyperspectral technology in material classification, a new hyperspectral classification method for foreign body detection in medicine based on spatial-spectral fusion feature is proposed in this paper, aiming at the problems of "dimension disaster" and low fusion degree of spectral feature and spatial feature. Firstly, a method combining PCA dimension reduction of band clustering grouping with semi-supervised LDA is proposed to extract spectral feature, while 2D Gabor filter is used to extract spatial feature. Then, a feature fusion network based on attention mechanism is proposed to fuse the spectral feature and spatial feature. Finally, the full connection layer and softmax classifier are used to realize the detection and classification of foreign bodies in medicine. The proposed method is applied to our own medicine data set, and the experiments constantly prove the effectiveness and superiority of our method.

[1]  Stefan Oehmcke,et al.  Attentional Feature Fusion , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[2]  Shigeaki Morita,et al.  Real-time determination and visualization of two independent quantities during a manufacturing process of pharmaceutical tablets by near-infrared hyperspectral imaging combined with multivariate analysis. , 2020, International journal of pharmaceutics.

[3]  A. Younis,et al.  A review of the application of near-infrared spectroscopy to rare traditional Chinese medicine. , 2019, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[4]  Eric Ziemons,et al.  Comparison of hyperspectral imaging techniques for the elucidation of falsified medicines composition. , 2019, Talanta.

[5]  Nicolas Audebert,et al.  Deep Learning for Classification of Hyperspectral Data: A Comparative Review , 2019, IEEE Geoscience and Remote Sensing Magazine.

[6]  Shih-Yu Chen,et al.  A New Application of Hyperspectral Techniques in Drug Classification , 2018, IIH-MSP.

[7]  Tao Li,et al.  Authenticity identification and classification of Rhodiola species in traditional Tibetan medicine based on Fourier transform near-infrared spectroscopy and chemometrics analysis. , 2018, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[8]  Qi Wang,et al.  Optimal Clustering Framework for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Patrick Lambert,et al.  3-D Deep Learning Approach for Remote Sensing Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Tao Li,et al.  HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image , 2018, 2018 International Conference on Audio, Language and Image Processing (ICALIP).

[11]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[12]  R. Koprowski,et al.  The use of hyperspectral imaging in the VNIR (400-1000nm) and SWIR range (1000-2500nm) for detecting counterfeit drugs with identical API composition. , 2016, Talanta.

[13]  Ilze Vermaak,et al.  Differentiation between two "fang ji" herbal medicines, Stephania tetrandra and the nephrotoxic Aristolochia fangchi, using hyperspectral imaging. , 2016, Phytochemistry.

[14]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.