Tongue colour and coating prediction in traditional Chinese medicine based on visible hyperspectral imaging

Tongue diagnosis is an important concept in Traditional Chinese Medicine (TCM). The tongue colour and coating can aid understanding of the body's physiological mechanisms, as well as the pathology of diseases. Existing research has focused on using digital images and tongue colour classification, without considering the other visible bands of information in the tongue. In this study, a visible hyperspectral image system, with an approximate spectral range of 400–1000 nm, was used to predict the tongue colour values and the coating position in TCM, and a stacked autoencoder (SAE) predict model based on spectral–spatial feature was performed to digital the tongue colour space and the coating. The experimental results show the effectiveness of the spectral–spatial feature with SAE model in predicting the CIELAB values of L, a, and coating position, thus the authors provide a new technique for the objective and digitising development of TCM.

[1]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Jon Atli Benediktsson,et al.  Effective Denoising and Classification of Hyperspectral Images Using Curvelet Transform and Singular Spectrum Analysis , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Kyungmo Park,et al.  Development of differential criteria on tongue coating thickness in tongue diagnosis. , 2012, Complementary therapies in medicine.

[4]  Qi Wang,et al.  Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Qi Tian,et al.  Sequential Video VLAD: Training the Aggregation Locally and Temporally , 2018, IEEE Transactions on Image Processing.

[6]  Gamal ElMasry,et al.  Near-infrared hyperspectral imaging for predicting colour, pH and tenderness of fresh beef , 2012 .

[7]  Jinchang Ren,et al.  Cognitive Computation of Compressed Sensing for Watermark Signal Measurement , 2016, Cognitive Computation.

[8]  Zhenfeng Shao,et al.  A Novel Hierarchical Semisupervised SVM for Classification of Hyperspectral Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[9]  Zhi Liu,et al.  Tongue color analysis and discrimination based on hyperspectral images , 2009, Comput. Medical Imaging Graph..

[10]  Giles M. Foody,et al.  Feature Selection for Classification of Hyperspectral Data by SVM , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Yuval Garini,et al.  Spectral imaging: Principles and applications , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[12]  David Zhang,et al.  Automatic tongue image segmentation based on gradient vector flow and region merging , 2010, Neural Computing and Applications.

[13]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Yicong Zhou,et al.  Learning Hierarchical Spectral–Spatial Features for Hyperspectral Image Classification , 2016, IEEE Transactions on Cybernetics.

[15]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[16]  Jon Atli Benediktsson,et al.  Multiple Feature Learning for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Bor-Chen Kuo,et al.  A Kernel-Based Feature Selection Method for SVM With RBF Kernel for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Shiming Xiang,et al.  Discriminant Tensor Spectral–Spatial Feature Extraction for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[19]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Jizhou Sun,et al.  What’s Wrong with the Murals at the Mogao Grottoes: A Near-Infrared Hyperspectral Imaging Method , 2015, Scientific Reports.

[21]  David Zhang,et al.  Automated tongue segmentation in hyperspectral images for medicine. , 2007, Applied optics.

[22]  Meijun Sun,et al.  How to predict the sugariness and hardness of melons: A near-infrared hyperspectral imaging method. , 2017, Food chemistry.

[23]  Arif Mahmood,et al.  Hyperspectral Face Recognition With Spatiospectral Information Fusion and PLS Regression , 2015, IEEE Transactions on Image Processing.

[24]  Liang Xu,et al.  Sublingual vein extraction algorithm based on hyperspectral tongue imaging technology , 2011, Comput. Medical Imaging Graph..

[25]  Xiaodong Li,et al.  A Dynamic Neighborhood Learning-Based Gravitational Search Algorithm , 2018, IEEE Transactions on Cybernetics.