Tongue Images Classification Based on Constrained High Dispersal Network

Computer aided tongue diagnosis has a great potential to play important roles in traditional Chinese medicine (TCM). However, the majority of the existing tongue image analyses and classification methods are based on the low-level features, which may not provide a holistic view of the tongue. Inspired by deep convolutional neural network (CNN), we propose a novel feature extraction framework called constrained high dispersal neural networks (CHDNet) to extract unbiased features and reduce human labor for tongue diagnosis in TCM. Previous CNN models have mostly focused on learning convolutional filters and adapting weights between them, but these models have two major issues: redundancy and insufficient capability in handling unbalanced sample distribution. We introduce high dispersal and local response normalization operation to address the issue of redundancy. We also add multiscale feature analysis to avoid the problem of sensitivity to deformation. Our proposed CHDNet learns high-level features and provides more classification information during training time, which may result in higher accuracy when predicting testing samples. We tested the proposed method on a set of 267 gastritis patients and a control group of 48 healthy volunteers. Test results show that CHDNet is a promising method in tongue image classification for the TCM study.

[1]  David Zhang,et al.  Tongue image analysis for appendicitis diagnosis , 2005, Inf. Sci..

[2]  Chun Yuan,et al.  Weighted-PCANet for Face Recognition , 2015, ICONIP.

[3]  Pong C. Yuen,et al.  Tongue image matching using color content , 2002, Pattern Recognit..

[4]  Jing Zhang,et al.  Preliminary Study of Tongue Image Classification Based on Multi-label Learning , 2015, ICIC.

[5]  David Zhang,et al.  Statistical Analysis of Tongue Images for Feature Extraction and Diagnostics , 2013, IEEE Transactions on Image Processing.

[6]  Li Zhuo,et al.  Tongue image classification based on Universum SVM , 2010, 2010 3rd International Conference on Biomedical Engineering and Informatics.

[7]  Zhenhua Guo Tongue Image Matching Using Color and Texture , 2008, ICMB.

[8]  Guitao Cao,et al.  Classification of Tongue Images Based on Doublet SVM , 2016, 2016 International Symposium on System and Software Reliability (ISSSR).

[9]  Yang Yang,et al.  Face image classification by pooling raw features , 2014, Pattern Recognit..

[10]  Jane You,et al.  Tongue Color Analysis for Medical Application , 2013, Evidence-based complementary and alternative medicine : eCAM.

[11]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[13]  Yongzhao Zhan,et al.  Unsupervised domain adaptation for speech emotion recognition using PCANet , 2016, Multimedia Tools and Applications.

[14]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[15]  Ratchadaporn Kanawong,et al.  ZHENG classification in Traditional Chinese Medicine based on modified specular-free tongue images , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops.

[16]  Lin Yang,et al.  Unified Saliency Detection Model Using Color and Texture Features , 2016, PloS one.

[17]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[18]  Ratchadaporn Kanawong,et al.  Features for automated tongue image shape classification , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[21]  Jie Yang,et al.  Region partition and feature matching based color recognition of tongue image , 2007, Pattern Recognit. Lett..

[22]  Tiejian Luo,et al.  Note: A manifold ranking based saliency detection method for camera. , 2016, The Review of scientific instruments.

[23]  Bob Zhang,et al.  Significant Geometry Features in Tongue Image Analysis , 2015, Evidence-based complementary and alternative medicine : eCAM.

[24]  Zhi Liu,et al.  Tongue color analysis and discrimination based on hyperspectral images , 2009, Comput. Medical Imaging Graph..

[25]  Long Chen,et al.  Human fall detection in surveillance video based on PCANet , 2016, Multimedia Tools and Applications.

[26]  Ye Duan,et al.  Automated Tongue Feature Extraction for ZHENG Classification in Traditional Chinese Medicine , 2012, Evidence-based complementary and alternative medicine : eCAM.

[27]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  David Zhang,et al.  A Kernel Classification Framework for Metric Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Ye Duan,et al.  Classification of tongue images based on doublet and color space dictionary , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[30]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[32]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.