Blood Cell Classification Based on Hyperspectral Imaging With Modulated Gabor and CNN

Cell classification, especially that of white blood cells, plays a very important role in the field of diagnosis and control of major diseases. Compared to traditional optical microscopic imaging, hyperspectral imagery, combined with both spatial and spectral information, provides more wealthy information for recognizing cells. In this paper, a novel blood cell classification framework, which combines a modulated Gabor wavelet and deep convolutional neural network (CNN) kernels, named as MGCNN, is proposed based on medical hyperspectral imaging. For each convolutional layer, multi-scale and orientation Gabor operators are taken dot product with initial CNN kernels. The essence is to transform the convolutional kernels into the frequency domain to learn features. By combining characteristics of Gabor wavelets, the features learned by modulated kernels at different frequencies and orientations are more representative and discriminative. Experimental results demonstrate that the proposed model can achieve better classification performance than traditional CNNs and widely used support vector machine approaches, especially as training small-sample-size situations.

[1]  Mei Zhou,et al.  Spectral-spatial feature-based neural network method for acute lymphoblastic leukemia cell identification via microscopic hyperspectral imaging technology. , 2017, Biomedical optics express.

[2]  Lei Wang,et al.  HEp-2 Cell Image Classification With Deep Convolutional Neural Networks , 2015, IEEE Journal of Biomedical and Health Informatics.

[3]  Li Liu,et al.  Recent Developments in Hyperspectral Imaging for Assessment of Food Quality and Safety , 2014, Sensors.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[6]  Wei Li,et al.  Cell classification using convolutional neural networks in medical hyperspectral imagery , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[7]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[8]  Y. Kosugi,et al.  Cancer detection using infrared hyperspectral imaging , 2011, Cancer science.

[9]  Mei Zhou,et al.  A spectral and morphologic method for white blood cell classification , 2016 .

[10]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Lin Zhu,et al.  Hyperspectral Images Classification With Gabor Filtering and Convolutional Neural Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[12]  Bogdan Kwolek,et al.  Face Detection Using Convolutional Neural Networks and Gabor Filters , 2005, ICANN.

[13]  Hichem Snoussi,et al.  Using Gabor filter in 3D convolutional neural networks for human action recognition , 2017, 2017 36th Chinese Control Conference (CCC).

[14]  Guolan Lu,et al.  Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging , 2017, Journal of biomedical optics.

[15]  Nelson Morgan,et al.  Robust CNN-based speech recognition with Gabor filter kernels , 2014, INTERSPEECH.

[16]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[17]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[18]  David Zhang,et al.  Classification of hyperspectral medical tongue images for tongue diagnosis , 2007, Comput. Medical Imaging Graph..

[19]  Mu-Chun Su,et al.  A Neural-Network-Based Approach to White Blood Cell Classification , 2014, TheScientificWorldJournal.

[20]  Shanjun Mao,et al.  Spectral–spatial classification of hyperspectral images using deep convolutional neural networks , 2015 .

[21]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Adnan Khashman,et al.  Blood Cell Identification using Emotional Neural Networks , 2009, J. Inf. Sci. Eng..

[23]  Malek Adjouadi,et al.  Classification of Leukemia Blood Samples Using Neural Networks , 2010, Annals of Biomedical Engineering.

[24]  K. V. Arya,et al.  Automated microscopic image analysis for leukocytes identification: a survey. , 2014, Micron.

[25]  Hui Lin,et al.  Classification of Hyperspectral Images by Gabor Filtering Based Deep Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Tuan Vo-Dinh,et al.  Development of an Advanced Hyperspectral Imaging (HSI) System with Applications for Cancer Detection , 2006, Annals of Biomedical Engineering.

[27]  Nasir M. Rajpoot,et al.  Texture based classification of hyperspectral colon biopsy samples using CLBP , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[28]  Yukio Kosugi,et al.  Detection and Analysis of the Intestinal Ischemia Using Visible and Invisible Hyperspectral Imaging , 2010, IEEE Transactions on Biomedical Engineering.

[29]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[30]  Luma V. Halig,et al.  Hyperspectral imaging and quantitative analysis for prostate cancer detection. , 2012, Journal of biomedical optics.

[31]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[32]  Filiberto Pla,et al.  Spectral–Spatial Pixel Characterization Using Gabor Filters for Hyperspectral Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[33]  Nasser M. Nasrabadi,et al.  Hyperspectral Target Detection : An Overview of Current and Future Challenges , 2014, IEEE Signal Processing Magazine.

[34]  Gongping Yang,et al.  Multiscale Rotation-Invariant Convolutional Neural Networks for Lung Texture Classification , 2018, IEEE Journal of Biomedical and Health Informatics.

[35]  Feng Liu,et al.  High-level spatial modeling in convolutional neural network with application to pedestrian detection , 2015, 2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE).

[36]  David Dagan Feng,et al.  An Ensemble of Fine-Tuned Convolutional Neural Networks for Medical Image Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[37]  Josée Lévesque,et al.  A demonstration of hyperspectral image exploitation for military applications , 2007, 2007 10th International Conference on Information Fusion.

[38]  Mira Barak,et al.  The rate of manual peripheral blood smear reviews in outpatients , 2009, Clinical chemistry and laboratory medicine.

[39]  Shuzhi Sam Ge,et al.  $k$-NS: A Classifier by the Distance to the Nearest Subspace , 2011, IEEE Transactions on Neural Networks.

[40]  Yue Xiao-qiang Tongue texture analysis and discrimination algorithm based on the hyperspectral image , 2007 .

[41]  Kashif Rajpoot,et al.  SVM Optimization for Hyperspectral Colon Tissue Cell Classification , 2004, MICCAI.

[42]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[43]  Dongsheng Wang,et al.  A Minimum Spanning Forest-Based Method for Noninvasive Cancer Detection With Hyperspectral Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[44]  Hongying Liu,et al.  New-Styled System Based on Hyperspectral Imaging , 2011, 2011 Symposium on Photonics and Optoelectronics (SOPO).

[45]  Qian Du,et al.  Gabor-Filtering-Based Nearest Regularized Subspace for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[46]  Guang-Zhong Yang,et al.  Manifold Embedding and Semantic Segmentation for Intraoperative Guidance With Hyperspectral Brain Imaging , 2017, IEEE Transactions on Medical Imaging.