A MDP solution for Traditional Chinese medicine treatment planning

Herbal medicine is the primary method of treatment in Traditional Chinese medicine (TCM) which proposes an essential health solution in China. Medical treatments are usually made by TCM physicians sequentially in an uncertain environment. Markov Decision Process (MDP) provides a powerful mathematical technique for planning in environment under uncertainty and is suitable for TCM therapy planning. In this paper, we apply MDP to solve TCM herbal treatment planning with all the parameters inferred from TCM clinical data for patient with type 2 diabetes. This MDP model contains 30 health states obtained using k-means clustering algorithm and 159 actions of basic prescriptions. This model could order sequences of prescriptions from the action set for patients with type 2 diabetes. The results show that the MDP model for TCM treatment planning can identify and order useful prescriptions which are reasonable in clinical practice.

[1]  J P Kassirer,et al.  Alternative medicine--the risks of untested and unregulated remedies. , 1998, The New England journal of medicine.

[2]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[3]  Yonghong Peng,et al.  Text mining for traditional Chinese medical knowledge discovery: A survey , 2010, J. Biomed. Informatics.

[4]  Zhaohui Wu,et al.  Knowledge discovery in traditional Chinese medicine: State of the art and perspectives , 2006, Artif. Intell. Medicine.

[5]  Leslie A Lenert,et al.  Discrete State Analysis for Interpretation of Data From Clinical Trials , 2004, Medical care.

[6]  Jin-Ling Tang,et al.  Traditional Chinese medicine , 2008, The Lancet.

[7]  Baoyan Liu,et al.  Development of traditional Chinese medicine clinical data warehouse for medical knowledge discovery and decision support , 2010, Artif. Intell. Medicine.

[8]  Giovanni Maciocia,et al.  The Foundations of Chinese Medicine: A Comprehensive Text for Acupuncturists and Herbalists , 2005 .

[9]  Peng Dai,et al.  Topological Value Iteration Algorithm for Markov Decision Processes , 2007, IJCAI.

[10]  J R Beck,et al.  Markov Models in Medical Decision Making , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[12]  Gareth M. James,et al.  Hidden Markov Models for Longitudinal Comparisons , 2005 .

[13]  Andrew J. Schaefer,et al.  Modeling Medical Treatment Using Markov Decision Processes , 2005 .