Developing Prediction Models from Results of Regression Analysis: Woodpecker ™ Technique

Background: Developing medical prediction models remains time and labor consuming. We propose the approach where information collected from published epidemiological outcome studies is quickly converted into prediction models. Methods: We used general expressions for regression models to derive prediction formulae defining the probability of the outcome and relative risk indicator. Risk indicator (R) is calculated as a linear combination of predictors multiplied by regression coefficients and then is placed on the scale of 0 to 10 for interpretability. Prediction expression for the probability (P) of the outcome is derived from general expression for logistic regression and proportional hazard models. The intercept is calculated based upon the outcome rate in the population and the risk indicator assigned to a subject representing mean characteristics of the population (E’). We also consider linear expression where probability of outcome is the product of risk indicator and the ratio of observed outcome rate and E’. Results: These models were explored and compared in a numeric simulation exercise and also using real data obtained from NHANES dataset. All three expressions generate very similar predictions in the lower categories of risk indicator. In the groups with the higher value of risk indicator linear expression tends to predict lower probability than exponential expressions and also lower than observed. Conclusions: We demonstrated simple technique (named Woodpecker™) that might allow deriving functional prediction model and risk stratification tool from the report of clinical outcome study using multivariate regression model.

[1]  John F. Hurdle,et al.  Validating Prediction Models of Kidney Transplant Outcome Using Single Center Data , 2011, ASAIO journal.

[2]  W Michalowski,et al.  Comparing predictions made by a prediction model, clinical score, and physicians , 2013, Applied Clinical Informatics.

[3]  Ralph B D'Agostino,et al.  Presentation of multivariate data for clinical use: The Framingham Study risk score functions. , 2005, Statistics in medicine.

[4]  A. Murray,et al.  Chronic kidney disease and the risk for cardiovascular disease, renal replacement, and death in the United States Medicare population, 1998 to 1999. , 2005, Journal of the American Society of Nephrology : JASN.

[5]  Ming Tu,et al.  Validating prediction models of kidney transplant outcome using local data. , 2007, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[6]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .

[7]  E. Marcantonio,et al.  Risk Factors for Hospitalization Among Community-Dwelling Primary Care Older Patients: Development and Validation of a Predictive Model , 2008, Medical care.

[8]  Keith C. Norris,et al.  Independent components of chronic kidney disease as a cardiovascular risk state: results from the Kidney Early Evaluation Program (KEEP). , 2007, Archives of internal medicine.

[9]  D. Hess,et al.  Development and Validation of a Score for Prediction of Postoperative Respiratory Complications , 2013, Anesthesiology.

[10]  A. Levey,et al.  A More Accurate Method To Estimate Glomerular Filtration Rate from Serum Creatinine: A New Prediction Equation , 1999, Annals of Internal Medicine.

[11]  T. Wen,et al.  Risk factors for abdominal bleeding after living-donor liver transplant. , 2014, Experimental and clinical transplantation : official journal of the Middle East Society for Organ Transplantation.

[12]  A. Goldfarb-Rumyantzev,et al.  Prediction of 3‐yr cadaveric graft survival based on pre‐transplant variables in a large national dataset , 2003, Clinical transplantation.

[13]  A. Hasslocher-Moreno,et al.  Development and validation of a risk score for predicting death in Chagas' heart disease. , 2006, The New England journal of medicine.

[14]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[15]  Zhongxin Zhang,et al.  Risk scores for predicting outcomes in patients with type 2 diabetes and nephropathy: the RENAAL study. , 2006, Clinical journal of the American Society of Nephrology : CJASN.

[16]  Katrin Uhlig,et al.  Risk Prediction Models for Patients With Chronic Kidney Disease , 2013, Annals of Internal Medicine.

[17]  E. Steyerberg,et al.  Reporting and Methods in Clinical Prediction Research: A Systematic Review , 2012, PLoS medicine.

[18]  Galit Shmueli,et al.  To Explain or To Predict? , 2010, 1101.0891.

[19]  K. Mouridsen,et al.  Automated Decision-Support System for Prediction of Treatment Responders in Acute Ischemic Stroke , 2013, Front. Neurol..