The K-nearest neighbor algorithm predicted rehabilitation potential better than current Clinical Assessment Protocol.

OBJECTIVE There may be great potential for using computer-modeling techniques and machine-learning algorithms in clinical decision making, if these can be shown to produce results superior to clinical protocols currently in use. We aim to explore the potential to use an automatic, data-driven, machine-learning algorithm in clinical decision making. STUDY DESIGN AND SETTING Using a database containing comprehensive health assessment information (the interRAI-HC) on home care clients (N=24,724) from eight community-care regions in Ontario, Canada, we compare the performance of the K-nearest neighbor (KNN) algorithm and a Clinical Assessment Protocol (the "ADLCAP") currently used to predict rehabilitation potential. For our purposes, we define a patient as having rehabilitation potential if the patient had functional improvement or remained at home over a follow-up period of approximately 1 year. RESULTS The KNN algorithm has a lower false positive rate in all but one of the eight regions in the sample, and lower false negative rates in all regions. Compared using likelihood ratio statistics, KNN is uniformly more informative than the ADLCAP. CONCLUSION This article illustrates the potential for a machine-learning algorithm to enhance clinical decision making.

[1]  Brant E. Fries,et al.  Problem Identification and Care Plan Responses in a Home and Community-Based Services Program , 2004 .

[2]  N. Ikegami,et al.  Comprehensive Clinical Assessment in Community Setting: Applicability of the MDS‐HC , 1997, Journal of the American Geriatrics Society.

[3]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[4]  E Ambrosioni,et al.  Comparison of three devices for measuring blood pressure. , 1985, Statistics in medicine.

[5]  Sing-Fai Tam,et al.  Predicting osteoarthritic knee rehabilitation outcome by using a prediction model developed by data mining techniques , 2004, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[6]  Trisha Greenhalgh,et al.  How to read a paper: Papers that report diagnostic or screening tests , 1997, BMJ.

[7]  T. Bayes An essay towards solving a problem in the doctrine of chances , 2003 .

[8]  Daniel B. Mark,et al.  TUTORIAL IN BIOSTATISTICS MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORS , 1996 .

[9]  G. Onder,et al.  Minimum Data Set for Home Care: A Valid Instrument to Assess Frail Older People Living in the Community , 2000, Medical care.

[10]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .

[11]  B E Fries,et al.  Scaling ADLs within the MDS. , 1999, The journals of gerontology. Series A, Biological sciences and medical sciences.

[12]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[13]  Kenneth J Ottenbacher,et al.  Comparison of logistic regression and neural network analysis applied to predicting living setting after hip fracture. , 2004, Annals of epidemiology.

[14]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[15]  A. O. Hughes,et al.  Clinical epidemiology a basic science for clinical medicine (2nd edition). David L. Sackett, R. Brian Haynes, Gordon H. Guyatt, Peter Tugwell, Little Brown and company, Bosten, 1991. no. of pages: xvii+441. price: £23.95, $32.50. ISBn: 0316‐76599‐6 , 1993 .

[16]  B E Fries,et al.  Integrated Health Information Systems Based on the RAI/MDS Series of Instruments , 1999, Healthcare management forum.

[17]  Arnold B Mitnitski,et al.  Techniques for knowledge discovery in existing biomedical databases: estimation of individual aging effects in cognition in relation to dementia. , 2003, Journal of clinical epidemiology.

[18]  D. Sackett,et al.  The Ends of Human Life: Medical Ethics in a Liberal Polity , 1992, Annals of Internal Medicine.

[19]  Naoki Ikegami,et al.  Home care quality indicators (HCQIs) based on the MDS-HC. , 2004, The Gerontologist.