Computer-aided tongue image diagnosis and analysis

Computer-aided diagnosis is a medical procedure that assist physicians in interpretation of medical images. This work focuses on computer-aided tongue image analysis, specifically, as it relates to Traditional Chinese Medicine (TCM). Tongue diagnosis is an important component of TCM. Computerized tongue diagnosis aid medical practitioners capture quantitative features to improve reliability and consistence of diagnosis. Recently, researchers have started to develop computer-aided tongue analysis algorithms based on new advancement in digital photogrammetry, image analysis and pattern recognition technologies. A total computer-aided tongue analysis framework consists of tongue detection, tongue segmentation, tongue feature extraction, tongue classification and analysis, which are all included in our work. We propose a new hybrid image segmentation algorithm that integrates the regionbased Mean Shift method with the boundary-based Canny Edge detection method. We apply this segmentation algorithm in designing an automatic tongue detection and segmentation framework. We also develop a novel color space based feature set for tongue feature extraction to implement an automated ZHENG (TCM syndrome) classification system using state of the art machine learning techniques. To further enhance the performance of our classification system, we propose preprocessing the tongue images using the Modified Specular-free technique prior to feature extraction. We also explore the extraction of geometry features from the Petechia dot on tongue images for improved classification. Lastly, we propose a new feature set for automated tongue shape classification. Experimental results obtained demonstrate the advantage of our proposed methods to current state of the art techniques.

[1]  Dimitris N. Metaxas,et al.  Automated 3D Segmentation Using Deformable Models and Fuzzy Affinity , 1997, IPMI.

[2]  Pong C. Yuen,et al.  Tongue image matching using color content , 2002, Pattern Recognit..

[3]  Honggang Zhang,et al.  Chromaticity-based separation of reflection components in a single image , 2008, Pattern Recognit..

[4]  Jie Yang,et al.  JSEG Based Color Separation of Tongue Image in Traditional Chinese Medicine , 2004, CIARP.

[5]  Jie Yang,et al.  Region partition and feature matching based color recognition of tongue image , 2007, Pattern Recognit. Lett..

[6]  Gérard G. Medioni,et al.  Inference of Surfaces, 3D Curves, and Junctions From Sparse, Noisy, 3D Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Adrian Ford,et al.  Colour Space Conversions_1 , 1998 .

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[10]  David Zhang,et al.  Automated tongue segmentation in hyperspectral images for medicine. , 2007, Applied optics.

[11]  David Zhang,et al.  The bi-elliptical deformable contour and its application to automated tongue segmentation in Chinese medicine , 2005, IEEE Transactions on Medical Imaging.

[12]  J. Tasic,et al.  Colour spaces: perceptual, historical and applicational background , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[13]  Mi-Suen Lee,et al.  N-Dimensional Tensor Voting and Application to Epipolar Geometry Estimation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Zhi-Kai Huang,et al.  Bark Classification Using RBPNN in Different Color Space , 2007 .

[15]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[16]  A. Beghdadi,et al.  Image quality assessment using a neural network approach , 2004, Proceedings of the Fourth IEEE International Symposium on Signal Processing and Information Technology, 2004..

[17]  Ye Duan,et al.  Automated Tongue Feature Extraction for ZHENG Classification in Traditional Chinese Medicine , 2012, Evidence-based complementary and alternative medicine : eCAM.

[18]  David Zhang,et al.  Dynamic tongueprint: A novel biometric identifier , 2010, Pattern Recognit..

[19]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[20]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[21]  Demetri Terzopoulos,et al.  Topology adaptive deformable surfaces for medical image volume segmentation , 1999, IEEE Transactions on Medical Imaging.

[22]  Dimitris N. Metaxas,et al.  Segmentation using deformable models with affinity-based localization , 1997, CVRMed.

[23]  Katsushi Ikeuchi,et al.  Separating reflection components based on chromaticity and noise analysis , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Dong Xu,et al.  An automatic tongue detection and segmentation framework for computer-aided tongue image analysis , 2011, 2011 IEEE 13th International Conference on e-Health Networking, Applications and Services.

[25]  Ye Duan,et al.  A new information fusion approach for image segmentation , 2011, 2011 18th IEEE International Conference on Image Processing.

[26]  Kuanquan Wang,et al.  A Feature Extraction Method for Recognition of Petechia Dot in Tongue Image , 2009, 2009 First International Conference on Information Science and Engineering.

[27]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[28]  Rémi Ronfard,et al.  Region-based strategies for active contour models , 1994, International Journal of Computer Vision.

[29]  James S. Duncan,et al.  Boundary Finding with Parametrically Deformable Models , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[33]  Yonghong Zhang,et al.  Tongue Area Extraction in Tongue Diagnosis of Traditional Chinese Medicine , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[34]  Chuang-Chien Chiu,et al.  A novel approach based on computerized image analysis for traditional Chinese medical diagnosis of the tongue , 2000, Comput. Methods Programs Biomed..

[35]  Shao Li,et al.  Bridging the gap between traditional Chinese medicine and systems biology: the connection of Cold Syndrome and NEI network. , 2010, Molecular bioSystems.

[36]  David Zhang,et al.  Tongue shape classification by geometric features , 2010, Inf. Sci..

[37]  Sing Bing Kang,et al.  Emerging Topics in Computer Vision , 2004 .

[38]  Dimitris N. Metaxas,et al.  A hybrid framework for 3D medical image segmentation , 2005, Medical Image Anal..

[39]  G. Medioni,et al.  Tensor voting in computer vision, visualization, and higher dimensional inferences , 2000 .

[40]  Dimitris N. Metaxas,et al.  Image segmentation based on the integration of pixel affinity and deformable models , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[41]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Pong C. Yuen,et al.  Regularized color clustering in medical image database , 2000, IEEE Transactions on Medical Imaging.

[43]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Yang Cai,et al.  A novel imaging system for tongue inspection , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[45]  Shen Zy,et al.  Basic theory of traditional Chinese medicine , 1997 .

[46]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[47]  Xuegong Zhang,et al.  Understanding ZHENG in traditional Chinese medicine in the context of neuro-endocrine-immune network. , 2007, IET systems biology.

[48]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[49]  Chun-Ming Tsai,et al.  Contrast compensation by fuzzy classification and image illumination analysis for back-lit and front-lit color face images , 2010, IEEE Transactions on Consumer Electronics.

[50]  Samuel H. Duncan,et al.  Integration Of Boundary Finding And Regionbased Segmentation Using Game Theory , 1995 .