Classification of Tongue Color Based on Convolution Neural Network

The color of the tongue is closely related to the patient’s physical condition and pathological condition, and it plays a very important position in the treatment and diagnosis of traditional Chinese medicine (TCM) clinical medicine. Convolutional neural network (CNN) has achieved fruitful results in image classification. Therefore, the method combining CNN with tongue color classification is proposed. Frist, initial data set is obtained by standardizing tongue image acquisition and tongue image preprocessing. Then, the Otsu method is applied on the image multi-channel to remove the background of the tongue accurately as the input of the model. At the same time, data augmentation is applied to avoid over-fitting of the model and improve the accuracy of model classification. The accuracy of the trained tongue color classifier based on CNN is 90.5% in the clinically collected data set, which is better than the traditional machine learning methods for tongue color classification.

[1]  He Fang-fang Color Classification of Tongue Based on PCA-AdaBoost in Traditional Chinese Medicine , 2009 .

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Li Zhuo,et al.  Automatic tongue color analysis of traditional Chinese medicine based on image retrieval , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[4]  Darko Stefanovic,et al.  Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification , 2016, Comput. Intell. Neurosci..

[5]  Xing Tao Tongue image classification based on rough set theory , 2007 .

[6]  Van-Dung Hoang,et al.  Deep CNN and Data Augmentation for Skin Lesion Classification , 2018, ACIIDS.

[7]  Serge Andrianov,et al.  Comparison of Regularization Methods for ImageNet Classification with Deep Convolutional Neural Networks , 2014 .

[8]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[9]  Zhang Xin Application of weighted SVM on the classification and recognition of tongue images , 2006 .

[10]  L Zhang,et al.  Tongue-coating image segmentation based on combination of morphological gradient and watershed algorithms , 2011 .

[11]  Balázs Harangi,et al.  Skin lesion detection based on an ensemble of deep convolutional neural network , 2017, J. Biomed. Informatics.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  David Zhang,et al.  Robust tongue segmentation by fusing region-based and edge-based approaches , 2015, Expert Syst. Appl..