Predicting individual disease risk based on medical history

The monumental cost of health care, especially for chronic disease treatment, is quickly becoming unmanageable. This crisis has motivated the drive towards preventative medicine, where the primary concern is recognizing disease risk and taking action at the earliest signs. However, universal testing is neither time nor cost efficient. We propose CARE, a Collaborative Assessment and Recommendation Engine, which relies only on a patient's medical history using ICD-9-CM codes in order to predict future diseases risks. CARE uses collaborative filtering to predict each patient's greatest disease risks based on their own medical history and that of similar patients. We also describe an Iterative version, ICARE, which incorporates ensemble concepts for improved performance. These novel systems require no specialized information and provide predictions for medical conditions of all kinds in a single run. We present experimental results on a Medicare dataset, demonstrating that CARE and ICARE perform well at capturing future disease risks.

[1]  T. Bodenheimer,et al.  Disease management in the American market , 2000, BMJ : British Medical Journal.

[2]  H P Hartung,et al.  Use of interferon beta in multiple sclerosis: rationale for early treatment and evidence for dose- and frequency-dependent effects on clinical response , 2002, Multiple sclerosis.

[3]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[4]  Vaclav Petricek,et al.  Recommender System for Online Dating Service , 2007, ArXiv.

[5]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[6]  J A Knottnerus,et al.  Multimorbidity in general practice: prevalence, incidence, and determinants of co-occurring chronic and recurrent diseases. , 1998, Journal of clinical epidemiology.

[7]  John Riedl,et al.  Towards a Scalable k NN CF Algorithm: Exploring Effective Applications of Clustering , 2006, WEBKDD.

[8]  Kate Lorig,et al.  Patients as partners in managing chronic disease , 2000, BMJ : British Medical Journal.

[9]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[10]  D. Snider,et al.  Indicators for chronic disease surveillance. , 2004, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[11]  P. Allison,et al.  Mortality after the hospitalization of a spouse. , 2006, The New England journal of medicine.

[12]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[13]  Kenneth Y. Goldberg,et al.  Eigentaste: A Constant Time Collaborative Filtering Algorithm , 2001, Information Retrieval.

[14]  Fillia Makedon,et al.  Using singular value decomposition approximation for collaborative filtering , 2005, Seventh IEEE International Conference on E-Commerce Technology (CEC'05).

[15]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[16]  Jon M. Kleinberg,et al.  Using mixture models for collaborative filtering , 2004, STOC '04.

[17]  D. Lauderdale,et al.  Epidemiologic uses of Medicare data. , 1993, Epidemiologic reviews.

[18]  A. Barabasi,et al.  Network medicine--from obesity to the "diseasome". , 2007, The New England journal of medicine.

[19]  Srujana Merugu,et al.  A scalable collaborative filtering framework based on co-clustering , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[20]  Yanxi Liu,et al.  DICOVERY OF "BIOMARKERS" FOR ALZHEIMER'S DISEASE PREDICTION FROM STRUCTURAL MR IMAGES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[21]  David Maxwell Chickering,et al.  Dependency Networks for Inference, Collaborative Filtering, and Data Visualization , 2000, J. Mach. Learn. Res..

[22]  Richard F Mould.  Prediction of long-term survival rates of cancer patients , 2003, The Lancet.

[23]  Eric Horvitz,et al.  Collaborative Filtering by Personality Diagnosis: A Hybrid Memory and Model-Based Approach , 2000, UAI.

[24]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[25]  Ralph Snyderman,et al.  Prospective medicine: the role for genomics in personalized health planning. , 2004, Pharmacogenomics.

[26]  C. T. Orleans,et al.  Does the chronic care model serve also as a template for improving prevention? , 2001, The Milbank quarterly.

[27]  D. Cherry,et al.  National Ambulatory Medical Care Survey: 2001 summary. , 2003, Advance data.

[28]  Raymond J. Mooney,et al.  Content-boosted collaborative filtering for improved recommendations , 2002, AAAI/IAAI.

[29]  Emily White,et al.  Physician recommendations for dietary change: their prevalence and impact in a population-based sample. , 1995, American journal of public health.

[30]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[31]  Alessandra Orlandini,et al.  Prediction of significant fibrosis in chronic hepatitis C patients by artificial neural network analysis of clinical factors , 2007 .

[32]  K. Kupka,et al.  International classification of diseases: ninth revision. , 1978, WHO chronicle.

[33]  Bradley N. Miller,et al.  GroupLens: applying collaborative filtering to Usenet news , 1997, CACM.

[34]  J. Loscalzo.  Association studies in an era of too much information: clinical analysis of new biomarker and genetic data. , 2007, Circulation.

[35]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[36]  R. Snyderman,et al.  Prospective Medicine: The Next Health Care Transformation , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[37]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[38]  Dean P. Foster,et al.  Clustering Methods for Collaborative Filtering , 1998, AAAI 1998.

[39]  Leroy Hood,et al.  Systems biology, proteomics, and the future of health care: toward predictive, preventative, and personalized medicine. , 2004, Journal of proteome research.

[40]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[41]  L. Muhlbaier,et al.  Using Medicare Claims for Outcomes Research , 1994, Medical care.

[42]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .

[43]  Thomas Hofmann,et al.  Latent Class Models for Collaborative Filtering , 1999, IJCAI.

[44]  Thomas Hofmann,et al.  Latent semantic models for collaborative filtering , 2004, TOIS.

[45]  Francisco Herrera,et al.  A Prediction System for Cardiovascularity Diseases Using Genetic Fuzzy Rule-Based Systems , 2002, IBERAMIA.

[46]  Luo Si,et al.  Flexible Mixture Model for Collaborative Filtering , 2003, ICML.

[47]  Christopher B Forrest,et al.  Comorbidity: Implications for the Importance of Primary Care in ‘Case’ Management , 2003, The Annals of Family Medicine.

[48]  Yehuda Koren,et al.  Improved Neighborhood-based Collaborative Filtering , 2007 .

[49]  Charles E. Kahn.  Collaborative Filtering to Improve Navigation of Large Radiology Knowledge Resources , 2004, Journal of Digital Imaging.

[50]  A. Barabasi,et al.  Human disease classification in the postgenomic era: A complex systems approach to human pathobiology , 2007, Molecular systems biology.

[51]  Jonathan L. Herlocker,et al.  Clustering items for collaborative filtering , 1999 .

[52]  David Edelman,et al.  A multidimensional integrative medicine intervention to improve cardiovascular risk , 2006, Journal of General Internal Medicine.

[53]  Dunja Mladenic,et al.  kNN Versus SVM in the Collaborative Filtering Framework , 2006, Data Science and Classification.

[54]  W. Knaus,et al.  Predicting outcome in critical care: the current status of the APACHE prognostic scoring system , 1991, Canadian journal of anaesthesia = Journal canadien d'anesthesie.