Combination of Principal Component Analysis and Bayesian Network and its Application on Syndrome Classification for Chronic Gastritis in Traditional Chinese Medicine

In many applications, there are problems of small sample size and high dimensionality of data, for example, in traditional Chinese medicine syndrome classification of chronic gastritis. To attack these problems, this paper gives a method which combines data preprocessing and Bayesian networks. Firstly, data is divided into groups with hierarchical clustering. Then, principal component analysis technique is used to extract principal components of each group of the data. At last, the new principal components are used to train a Bayesian network classifier. Experiment results demonstrate that the method is feasible and effective.

[1]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[2]  Jing Zhou,et al.  Learning Bayesian networks with a hybrid convergent method , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[3]  Man Leung Wong,et al.  A Novel Hybrid Evolutionary Algorithm for Learning Bayesian Networks from Incomplete Data , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[4]  Pedro Larrañaga,et al.  Learning Bayesian network structures by searching for the best ordering with genetic algorithms , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[5]  Alexey Tsymbal,et al.  Ensemble feature selection with the simple Bayesian classification in medical diagnostics , 2002, Proceedings of 15th IEEE Symposium on Computer-Based Medical Systems (CBMS 2002).

[6]  P. Spirtes,et al.  An Algorithm for Fast Recovery of Sparse Causal Graphs , 1991 .

[7]  David Heckerman,et al.  Learning Bayesian Networks: Search Methods and Experimental Results , 1995 .

[8]  David A. Bell,et al.  Learning Bayesian networks from data: An information-theory based approach , 2002, Artif. Intell..

[9]  Rahul Sukthankar,et al.  Complete Cross-Validation for Nearest Neighbor Classifiers , 2000, ICML.

[10]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[11]  Omolola Ogunyemi,et al.  Using Bayesian networks for diagnostic reasoning in penetrating injury assessment , 2000, Proceedings 13th IEEE Symposium on Computer-Based Medical Systems. CBMS 2000.

[12]  Kathryn B. Laskey,et al.  Learning Bayesian networks from incomplete data using evolutionary algorithms , 1999 .

[13]  Xu Wen-li.  Thinking and approaches on treatment of chronic gastritis with integration of traditional Chinese and western medicine , 2001 .

[14]  Nir Friedman,et al.  Learning Bayesian Networks with Local Structure , 1996, UAI.

[15]  Jose Miguel Puerta,et al.  Ant colony optimization for learning Bayesian networks , 2002, Int. J. Approx. Reason..