Development and Validation of a Tool to Identify Patients With Type 2 Diabetes at High Risk of Hypoglycemia-Related Emergency Department or Hospital Use

Importance Hypoglycemia-related emergency department (ED) or hospital use among patients with type 2 diabetes (T2D) is clinically significant and possibly preventable. Objective To develop and validate a tool to categorize risk of hypoglycemic-related utilization in patients with T2D. Design, Setting, and Participants Using recursive partitioning with a split-sample design, we created a classification tree based on potential predictors of hypoglycemia-related ED or hospital use. The resulting model was transcribed into a tool for practical application and tested in 1 internal and 2 fully independent, external samples. Development and internal testing was conducted in a split sample of 206 435 patients with T2D from Kaiser Permanente Northern California (KPNC), an integrated health care system. The tool was externally tested in 1 335 966 Veterans Health Administration and 14 972 Group Health Cooperative patients with T2D. Exposures Based on a literature review, we identified 156 candidate predictor variables (prebaseline exposures) using data collected from electronic medical records. Main Outcomes and Measures Hypoglycemia-related ED or hospital use during 12 months of follow-up. Results The derivation sample (n = 165 148) had a mean (SD) age of 63.9 (13.0) years and included 78 576 (47.6%) women. The crude annual rate of at least 1 hypoglycemia-related ED or hospital encounter in the KPNC derivation sample was 0.49%. The resulting hypoglycemia risk stratification tool required 6 patient-specific inputs: number of prior episodes of hypoglycemia-related utilization, insulin use, sulfonylurea use, prior year ED use, chronic kidney disease stage, and age. We categorized the predicted 12-month risk of any hypoglycemia-related utilization as high (>5%), intermediate (1%-5%), or low (<1%). In the internal validation sample, 2.0%, 10.7%, and 87.3% were categorized as high, intermediate, and low risk, respectively, with observed 12-month hypoglycemia-related utilization rates of 6.7%, 1.4%, and 0.2%, respectively. There was good discrimination in the internal validation KPNC sample (C statistic = 0.83) and both external validation samples (Veterans Health Administration: C statistic = 0.81; Group Health Cooperative: C statistic = 0.79). Conclusions and Relevance This hypoglycemia risk stratification tool categorizes the 12-month risk of hypoglycemia-related utilization in patients with T2D using only 6 inputs. This tool could facilitate targeted population management interventions, potentially reducing hypoglycemia risk and improving patient safety and quality of life.

[1]  D. Musher,et al.  Hypoglycemia as a manifestation of sepsis. , 1980, The American journal of medicine.

[2]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[3]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[4]  G. Striker Modification of diet in renal disease. , 1992, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[5]  A. Levey,et al.  A More Accurate Method To Estimate Glomerular Filtration Rate from Serum Creatinine: A New Prediction Equation , 1999, Annals of Internal Medicine.

[6]  K. Covinsky,et al.  Assessing the Generalizability of Prognostic Information , 1999, Annals of Internal Medicine.

[7]  R. Lewis An Introduction to Classification and Regression Tree (CART) Analysis , 2000 .

[8]  Louise C. Walter,et al.  Development and validation of a prognostic index for 1-year mortality in older adults after hospitalization. , 2001 .

[9]  W John Boscardin,et al.  Risk stratification for in-hospital mortality in acutely decompensated heart failure: classification and regression tree analysis. , 2005, JAMA.

[10]  Workgroup on Hypoglycemia Defining and reporting hypoglycemia in diabetes: a report from the American Diabetes Association Workgroup on Hypoglycemia. , 2005, Diabetes care.

[11]  C. Ricordi,et al.  Clinical islet transplantation. , 2006, Minerva endocrinologica.

[12]  S. Amiel,et al.  Hypoglycaemia in Type 2 diabetes , 2008, Diabetic medicine : a journal of the British Diabetic Association.

[13]  Donald R. Miller,et al.  Longitudinal Approaches to Evaluate Health Care Quality and Outcomes: The Veterans Health Administration Diabetes Epidemiology Cohorts , 2008, Journal of diabetes science and technology.

[14]  C. Camargo,et al.  Validation of ICD-9-CM coding algorithm for improved identification of hypoglycemia visits , 2008, BMC endocrine disorders.

[15]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: validating a prognostic model , 2009, BMJ : British Medical Journal.

[16]  Romain Neugebauer,et al.  Cohort Profile: The Diabetes Study of Northern California (DISTANCE)--objectives and design of a survey follow-up study of social health disparities in a managed care population. , 2009, International journal of epidemiology.

[17]  Kristine Yaffe,et al.  Hypoglycemic episodes and risk of dementia in older patients with type 2 diabetes mellitus. , 2009, JAMA.

[18]  P. Royston,et al.  Prognosis and prognostic research: application and impact of prognostic models in clinical practice , 2009, BMJ : British Medical Journal.

[19]  G. Bedogni,et al.  Clinical Prediction Models—a Practical Approach to Development, Validation and Updating , 2009 .

[20]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: Developing a prognostic model , 2009, BMJ : British Medical Journal.

[21]  Urmimala Sarkar,et al.  Hypoglycemia is More Common Among Type 2 Diabetes Patients with Limited Health Literacy: The Diabetes Study of Northern California (DISTANCE) , 2010, Journal of General Internal Medicine.

[22]  D. Aron,et al.  Balancing hypoglycemia and glycemic control: a public health approach for insulin safety. , 2010, JAMA.

[23]  Jesse C. Crosson,et al.  Barriers to Insulin Initiation , 2010, Diabetes Care.

[24]  Mark Woodward,et al.  Severe hypoglycemia and risks of vascular events and death. , 2010, The New England journal of medicine.

[25]  Hypoglycemia and adverse outcomes: marker or mediator? , 2011, Reviews in cardiovascular medicine.

[26]  C. Richards,et al.  Emergency hospitalizations for adverse drug events in older Americans. , 2011, The New England journal of medicine.

[27]  Jennifer Y. Liu,et al.  Correlates of Quality of Life in Older Adults With Diabetes , 2011, Diabetes Care.

[28]  Jennifer Y. Liu,et al.  Glycemic Control, Complications, and Death in Older Diabetic Patients , 2011, Diabetes Care.

[29]  Lloyd E Chambless,et al.  Several methods to assess improvement in risk prediction models: Extension to survival analysis , 2011, Statistics in medicine.

[30]  N. Shah,et al.  Increased Mortality of Patients With Diabetes Reporting Severe Hypoglycemia , 2012, Diabetes Care.

[31]  Michael E. Miller,et al.  Severe hypoglycemia symptoms, antecedent behaviors, immediate consequences and association with glycemia medication usage: Secondary analysis of the ACCORD clinical trial data , 2012, BMC Endocrine Disorders.

[32]  D. Aron,et al.  The other side of quality improvement in diabetes for seniors: a proposal for an overtreatment glycemic measure. , 2012, Archives of internal medicine.

[33]  B. Frier,et al.  Hypoglycaemia and accident risk in people with type 2 diabetes mellitus treated with non-insulin antidiabetes drugs , 2012, Diabetes, obesity & metabolism.

[34]  M. Tonelli,et al.  Hypoglycemia Associated With Hospitalization and Adverse Events in Older People , 2013, Diabetes Care.

[35]  R. Vigersky,et al.  Hypoglycemia and Diabetes: A Report of a Workgroup of the American Diabetes Association and The Endocrine Society , 2013, Diabetes Care.

[36]  H. Krumholz,et al.  HbA1c and Risk of Severe Hypoglycemia in Type 2 Diabetes , 2013, Diabetes Care.

[37]  K. Bibbins-Domingo,et al.  Exhaustion of food budgets at month's end and hospital admissions for hypoglycemia. , 2014, Health affairs.

[38]  Sei J. Lee So much insulin, so much hypoglycemia. , 2014, JAMA internal medicine.

[39]  Desmond E. Williams,et al.  Changes in diabetes-related complications in the United States, 1990-2010. , 2014, The New England journal of medicine.

[40]  M. Hanefeld,et al.  Relationship Between Hypoglycemic Episodes and Ventricular Arrhythmias in Patients With Type 2 Diabetes and Cardiovascular Diseases: Silent Hypoglycemias and Silent Arrhythmias , 2014, Diabetes Care.

[41]  L Heinemann,et al.  Evidence for continuous glucose monitoring: sufficient for reimbursement? , 2014, Diabetic medicine : a journal of the British Diabetic Association.

[42]  Jennifer Y. Liu,et al.  Rates of complications and mortality in older patients with diabetes mellitus: the diabetes and aging study. , 2014, JAMA internal medicine.

[43]  C. Östenson,et al.  Research: Complications Self-reported non-severe hypoglycaemic events in Europe , 2013, Diabetic medicine : a journal of the British Diabetic Association.

[44]  Harlan M Krumholz,et al.  National trends in US hospital admissions for hyperglycemia and hypoglycemia among Medicare beneficiaries, 1999 to 2011. , 2014, JAMA internal medicine.

[45]  Jennifer Y. Liu,et al.  Low Socioeconomic Status is Associated with Increased Risk for Hypoglycemia in Diabetes Patients: The Diabetes Study of Northern California (DISTANCE) , 2014, Journal of health care for the poor and underserved.

[46]  W. Clarke,et al.  Understanding the construct of fear of hypoglycemia in pediatric type 1 diabetes. , 2014, Journal of pediatric psychology.

[47]  K. Lipska Improving safety of diabetes mellitus management. , 2014, JAMA internal medicine.

[48]  G. Collins,et al.  Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies: The CHARMS Checklist , 2014, PLoS medicine.

[49]  Assessing Potential Glycemic Overtreatment in Persons at Hypoglycemic Risk , 2014 .

[50]  M. Rickels,et al.  Consistency of quantitative scores of hypoglycemia severity and glycemic lability and comparison with continuous glucose monitoring system measures in long-standing type 1 diabetes. , 2015, Diabetes technology & therapeutics.

[51]  C. Emery,et al.  A cluster randomized controlled non‐inferiority trial of 5‐day Dose Adjustment for Normal Eating (DAFNE) training delivered over 1 week versus 5‐day DAFNE training delivered over 5 weeks: the DAFNE 5 × 1‐day trial , 2015, Diabetic medicine : a journal of the British Diabetic Association.

[52]  F. Snoek,et al.  HypoAware-a brief and partly web-based psycho-educational group intervention for adults with type 1 and insulin-treated type 2 diabetes and problematic hypoglycaemia: design of a cost-effectiveness randomised controlled trial , 2015, BMC Endocrine Disorders.

[53]  PHYTOPLASMAS IN POME FRUIT TREES: UPDATE OF THEIR PRESENCE AND THEIR VECTORS IN BELGIUM. , 2015, Communications in agricultural and applied biological sciences.

[54]  S. Italia The social burden of hypoglycemia in the elderly , 2015 .

[55]  B. Frier,et al.  Impaired Awareness of Hypoglycemia in Adults With Type 1 Diabetes Is Not Associated With Autonomic Dysfunction or Peripheral Neuropathy , 2015, Diabetes Care.

[56]  R. Whittemore,et al.  Development of an Educational Program on Prevention of Hypoglycemic Events Among Elderly Veterans With Type 2 Diabetes , 2015, The Diabetes educator.

[57]  B. M. Frier,et al.  Hypoglycaemia in adults with insulin‐treated diabetes in the UK: self‐reported frequency and effects , 2016, Diabetic medicine : a journal of the British Diabetic Association.

[58]  J. Twisk,et al.  Effectiveness of HypoAware, a Brief Partly Web-Based Psychoeducational Intervention for Adults With Type 1 and Insulin-Treated Type 2 Diabetes and Problematic Hypoglycemia: A Cluster Randomized Controlled Trial , 2016, Diabetes Care.

[59]  V. Montori,et al.  Inclusion of Hypoglycemia in Clinical Practice Guidelines and Performance Measures in the Care of Patients With Diabetes. , 2016, JAMA internal medicine.

[60]  V. Montori,et al.  Intensive Treatment and Severe Hypoglycemia Among Adults With Type 2 Diabetes. , 2016, JAMA internal medicine.

[61]  V. Montori,et al.  Hypoglycemia as an indicator of good diabetes care , 2016, British Medical Journal.

[62]  F. Snoek,et al.  HypoAware: development and pilot study of a brief and partly web‐based psychoeducational group intervention for adults with Type 1 and insulin‐treated Type 2 diabetes and problematic hypoglycaemia , 2016, Diabetic medicine : a journal of the British Diabetic Association.

[63]  W. Meurer,et al.  Logistic Regression Diagnostics: Understanding How Well a Model Predicts Outcomes , 2017, JAMA.

[64]  S. Basu,et al.  The Monthly Cycle of Hypoglycemia , 2017, Medical care.