Risk Adjustment of Ischemic Stroke Outcomes for Comparing Hospital Performance: A Statement for Healthcare Professionals From the American Heart Association/American Stroke Association

Background and Purpose— Stroke is the fourth-leading cause of death and a leading cause of long-term major disability in the United States. Measuring outcomes after stroke has important policy implications. The primary goals of this consensus statement are to (1) review statistical considerations when evaluating models that define hospital performance in providing stroke care; (2) discuss the benefits, limitations, and potential unintended consequences of using various outcome measures when evaluating the quality of ischemic stroke care at the hospital level; (3) summarize the evidence on the role of specific clinical and administrative variables, including patient preferences, in risk-adjusted models of ischemic stroke outcomes; (4) provide recommendations on the minimum list of variables that should be included in risk adjustment of ischemic stroke outcomes for comparisons of quality at the hospital level; and (5) provide recommendations for further research. Methods and Results— This statement gives an overview of statistical considerations for the evaluation of hospital-level outcomes after stroke and provides a systematic review of the literature for the following outcome measures for ischemic stroke at 30 days: functional outcomes, mortality, and readmissions. Data on outcomes after stroke have primarily involved studies conducted at an individual patient level rather than a hospital level. On the basis of the available information, the following factors should be included in all hospital-level risk-adjustment models: age, sex, stroke severity, comorbid conditions, and vascular risk factors. Because stroke severity is the most important prognostic factor for individual patients and appears to be a significant predictor of hospital-level performance for 30-day mortality, inclusion of a stroke severity measure in risk-adjustment models for 30-day outcome measures is recommended. Risk-adjustment models that do not include stroke severity or other recommended variables must provide comparable classification of hospital performance as models that include these variables. Stroke severity and other variables that are included in risk-adjustment models should be standardized across sites, so that their reliability and accuracy are equivalent. There is a pressing need for research in multiple areas to better identify methods and metrics to evaluate outcomes of stroke care. Conclusions— There are a number of important methodological challenges in undertaking risk-adjusted outcome comparisons to assess the quality of stroke care in different hospitals. It is important for stakeholders to recognize these challenges and for there to be a concerted approach to improving the methods for quality assessment and improvement.

[1]  P. Sandercock,et al.  The third International Stroke Trial (IST-3) , 2016 .

[2]  D. Mozaffarian,et al.  Heart disease and stroke statistics--2014 update: a report from the American Heart Association. , 2014, Circulation.

[3]  M. Wintermark,et al.  Guidelines for the Early Management of Patients With Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association , 2013, Stroke.

[4]  Peter C. Austin,et al.  The Relationship Between the C-Statistic of a Risk-adjustment Model and the Accuracy of Hospital Report Cards: A Monte Carlo Study , 2013, Medical care.

[5]  S. Johnsen,et al.  Higher Stroke Unit Volume Associated With Improved Quality of Early Stroke Care and Reduced Length of Stay , 2012, Stroke.

[6]  Adrian F Hernandez,et al.  Comparison of 30-day mortality models for profiling hospital performance in acute ischemic stroke with vs without adjustment for stroke severity. , 2012, JAMA.

[7]  D. Bravata,et al.  Does the Inclusion of Stroke Severity in a 30-Day Mortality Model Change Standardized Mortality Rates at Veterans Affairs Hospitals? , 2012, Circulation. Cardiovascular quality and outcomes.

[8]  J. Saver,et al.  Statistical Analysis of the Primary Outcome in Acute Stroke Trials , 2012, Stroke.

[9]  Werner Hacke,et al.  Contemporary Outcome Measures in Acute Stroke Research: Choice of Primary Outcome Measure , 2012, Stroke.

[10]  V. Howard,et al.  A Simple, Assumption-Free, and Clinically Interpretable Approach for Analysis of Modified Rankin Outcomes , 2012, Stroke.

[11]  Joseph P. Broderick,et al.  Relationship of National Institutes of Health Stroke Scale to 30-Day Mortality in Medicare Beneficiaries With Acute Ischemic Stroke , 2012, Journal of the American Heart Association.

[12]  Amanda H. Salanitro,et al.  Estimating and Reporting on the Quality of Inpatient Stroke Care by Veterans Health Administration Medical Centers , 2012, Circulation. Cardiovascular quality and outcomes.

[13]  Eric E. Smith,et al.  Stroke Quality Metrics: Systematic Reviews of the Relationships to Patient-Centered Outcomes and Impact of Public Reporting , 2012, Stroke.

[14]  G. Andersen,et al.  In-Hospital Medical Complications, Length of Stay, and Mortality Among Stroke Unit Patients , 2011, Stroke.

[15]  L. Goldstein,et al.  Concerns for the Reliability and Validity of the National Stroke Project Stroke Severity Scale , 2011, Cerebrovascular Diseases.

[16]  W. Freeman,et al.  Association between weekend hospital presentation and stroke fatality , 2011, Neurology.

[17]  David J. Spiegelhalter,et al.  The Identification of “Unusual” Health-Care Providers From a Hierarchical Model , 2011 .

[18]  Neil Fleming,et al.  Effectiveness and cost of a transitional care program for heart failure: a prospective study with concurrent controls. , 2011, Archives of internal medicine.

[19]  Stefan Gravenstein,et al.  The care transitions intervention: translating from efficacy to effectiveness. , 2011, Archives of internal medicine.

[20]  J. Clarke,et al.  What is a systematic review? , 2011, Evidence Based Nursing.

[21]  L. Daly,et al.  Association Between Acute Statin Therapy, Survival, and Improved Functional Outcome After Ischemic Stroke: The North Dublin Population Stroke Study , 2011, Stroke.

[22]  R. Scott,et al.  Impact of COX-2 rs5275 and rs20417 and GPIIIa rs5918 polymorphisms on 90-day ischemic stroke functional outcome: a novel finding. , 2011, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[23]  Harlan M. Krumholz,et al.  An Administrative Claims Measure Suitable for Profiling Hospital Performance Based on 30-Day All-Cause Readmission Rates Among Patients With Acute Myocardial Infarction , 2011, Circulation. Cardiovascular quality and outcomes.

[24]  Ming Liu,et al.  Characteristics, Treatment and Outcome of Ischemic Stroke with Atrial Fibrillation in a Chinese Hospital-Based Stroke Study , 2011, Cerebrovascular Diseases.

[25]  Gustavo Saposnik,et al.  IScore: A Risk Score to Predict Death Early After Hospitalization for an Acute Ischemic Stroke , 2011, Circulation.

[26]  M. Shah,et al.  Racial Differences in Mortality Among Patients With Acute Ischemic Stroke , 2011, Annals of Internal Medicine.

[27]  M. Shah,et al.  Association between stroke center hospitalization for acute ischemic stroke and mortality. , 2011, JAMA.

[28]  Eric E. Smith,et al.  Hospital-Level Variation in Mortality and Rehospitalization for Medicare Beneficiaries With Acute Ischemic Stroke , 2011, Stroke.

[29]  F. Silver,et al.  Association between weekend hospital presentation and stroke fatality , 2010, Neurology.

[30]  L. Goldstein,et al.  Predictors of Hospital Readmission After Stroke: A Systematic Review , 2010, Stroke.

[31]  V. Sharma,et al.  Feasibility and safety of intravenous thrombolysis in multiethnic Asian stroke patients in Singapore. , 2010, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[32]  Eric E. Smith,et al.  Risk Score for In-Hospital Ischemic Stroke Mortality Derived and Validated Within the Get With The Guidelines–Stroke Program , 2010, Circulation.

[33]  M. Faouzi,et al.  J-Shaped Association Between Serum Glucose and Functional Outcome in Acute Ischemic Stroke , 2010, Stroke.

[34]  J. Saver,et al.  Disability status at 1 month is a reliable proxy for final ischemic stroke outcome , 2010, Neurology.

[35]  P. Kelly,et al.  Stroke Subtype Classification to Mechanism-Specific and Undetermined Categories by TOAST, A-S-C-O, and Causative Classification System: Direct Comparison in the North Dublin Population Stroke Study , 2010, Stroke.

[36]  K. Stronks,et al.  A multifaceted look at time of admission and its impact on case-fatality among a cohort of ischaemic stroke patients , 2010, Journal of Neurology, Neurosurgery & Psychiatry.

[37]  J. Concato,et al.  Processes of care associated with acute stroke outcomes. , 2010, Archives of internal medicine.

[38]  D. Lloyd‐Jones Cardiovascular risk prediction: basic concepts, current status, and future directions. , 2010, Circulation.

[39]  Eric E. Smith,et al.  Characteristics, Performance Measures, and In-Hospital Outcomes of the First One Million Stroke and Transient Ischemic Attack Admissions in Get With The Guidelines-Stroke , 2010, Circulation. Cardiovascular quality and outcomes.

[40]  Ming Liu,et al.  One-Year Case Fatality and Disability after Posterior Circulation Infarction in a Chinese Hospital-Based Stroke Study , 2010, Cerebrovascular Diseases.

[41]  J. Lave,et al.  Is Survival Better at Hospitals With Higher “End-of-Life” Treatment Intensity? , 2010, Medical care.

[42]  K. Stronks,et al.  Hospital Stroke Volume and Case-Fatality Revisited , 2010, Medical care.

[43]  C. Caminiti,et al.  The Poor Outcome of Ischemic Stroke in Very Old People: A Cohort Study of Its Determinants , 2010, Journal of the American Geriatrics Society.

[44]  Hsiu-Fen Lin,et al.  Cerebral White Matter Hyperintensities Predict Functional Stroke Outcome , 2009, Cerebrovascular Diseases.

[45]  L. Goldstein,et al.  Stroke Patient Outcomes in US Hospitals Before the Start of the Joint Commission Primary Stroke Center Certification Program , 2009, Stroke.

[46]  Yan Sun,et al.  Impact of diabetes mellitus (DM) on the health-care utilization and clinical outcomes of patients with stroke in Singapore. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[47]  M. Tseng,et al.  Readmission after hospitalization for stroke in Taiwan: Results from a national sample , 2009, Journal of the Neurological Sciences.

[48]  J. Serena,et al.  Brachial arterial flow mediated dilation in acute ischemic stroke , 2009, European journal of neurology.

[49]  P. Sandercock,et al.  Progress Review Blood Markers for the Prognosis of Ischemic Stroke A Systematic Review , 2009 .

[50]  J. Deeks,et al.  Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals , 2009, BMJ : British Medical Journal.

[51]  Stephen A. Martin,et al.  A Reengineered Hospital Discharge Program to Decrease Rehospitalization , 2009, Annals of Internal Medicine.

[52]  Eric E. Smith,et al.  Off-Hour Admission and In-Hospital Stroke Case Fatality in the Get With The Guidelines-Stroke Program , 2009, Stroke.

[53]  M. Kaste,et al.  Thrombolysis with alteplase 3 to 4.5 hours after acute ischemic stroke. , 2008, The New England journal of medicine.

[54]  Sharon-Lise T. Normand,et al.  An Administrative Claims Measure Suitable for Profiling Hospital Performance on the Basis of 30-Day All-Cause Readmission Rates Among Patients With Heart Failure , 2008, Circulation. Cardiovascular quality and outcomes.

[55]  V. Hachinski,et al.  Variables Associated With 7-Day, 30-Day, and 1-Year Fatality After Ischemic Stroke , 2008, Stroke.

[56]  W. Coster,et al.  Analyzing change in recovery patterns in the year after acute hospitalization. , 2008, Archives of physical medicine and rehabilitation.

[57]  Peter C. Austin,et al.  Optimal Bayesian probability levels for hospital report cards , 2008, Health Services and Outcomes Research Methodology.

[58]  J. De Keyser,et al.  Safety of antiplatelet therapy prior to intravenous thrombolysis in acute ischemic stroke. , 2008, Archives of neurology.

[59]  Sharon-Lise T Normand,et al.  Comparison of “Risk-Adjusted” Hospital Outcomes , 2008, Circulation.

[60]  A. Alexandrov,et al.  Association of Pretreatment ASPECTS Scores with tPA‐Induced Arterial Recanalization in Acute Middle Cerebral Artery Occlusion , 2008, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[61]  A. Auerbach,et al.  Outcomes of care by hospitalists, general internists, and family physicians. , 2007, The New England journal of medicine.

[62]  A. Pancioli,et al.  Implementation strategies for emergency medical services within stroke systems of care: a policy statement from the American Heart Association/American Stroke Association Expert Panel on Emergency Medical Services Systems and the Stroke Council. , 2007, Stroke.

[63]  Jon Nicholl,et al.  Case-mix adjustment in non-randomised observational evaluations: the constant risk fallacy , 2007, Journal of Epidemiology & Community Health.

[64]  J. M. Gordon HOSPITAL VOLUME AND STROKE OUTCOME: DOES IT MATTER? , 2007, Neurology.

[65]  P. Sandercock,et al.  Predicting outcome in hyper-acute stroke: validation of a prognostic model in the Third International Stroke Trial (IST3) , 2007, Journal of Neurology, Neurosurgery, and Psychiatry.

[66]  R. Holloway,et al.  Mortality as a measure of quality: implications for palliative and end-of-life care. , 2007, JAMA.

[67]  Y. Tabak,et al.  Using Automated Clinical Data for Risk Adjustment: Development and Validation of Six Disease-Specific Mortality Predictive Models for Pay-for-Performance , 2007, Medical care.

[68]  R. Lilford,et al.  What is the empirical evidence that hospitals with higher-risk adjusted mortality rates provide poorer quality care? A systematic review of the literature , 2007, BMC Health Services Research.

[69]  J. Concato,et al.  Readmission and Death After Hospitalization for Acute Ischemic Stroke: 5-Year Follow-Up in the Medicare Population , 2007, Stroke.

[70]  Sharon-Lise T. Normand,et al.  Statistical and Clinical Aspects of Hospital Outcomes Profiling , 2007, 0710.4622.

[71]  S. Pocock,et al.  Can We Improve the Statistical Analysis of Stroke Trials?: Statistical Reanalysis of Functional Outcomes in Stroke Trials , 2007, Stroke.

[72]  Peter Langhorne,et al.  Facilitating recovery: evidence for organized stroke care. , 2007, Journal of rehabilitation medicine.

[73]  E. Vicaut,et al.  Early decompressive surgery in malignant infarction of the middle cerebral artery: a pooled analysis of three randomised controlled trials , 2007, The Lancet Neurology.

[74]  A. Alexandrov,et al.  Association of Pretreatment Blood Pressure With Tissue Plasminogen Activator-Induced Arterial Recanalization in Acute Ischemic Stroke , 2007, Stroke.

[75]  S. Corr Can we improve the statistical analysis of stroke trials? Statistical reanalysis of functional outcomes in stroke trials , 2007 .

[76]  N. Cook Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[77]  P. Duncan,et al.  Multiple System Utilization and Mortality for Veterans With Stroke , 2007, Stroke.

[78]  Sudha Seshadri,et al.  Trends in incidence, lifetime risk, severity, and 30-day mortality of stroke over the past 50 years. , 2006, JAMA.

[79]  David C Hoaglin,et al.  The Hazards of Using Administrative Data to Measure Surgical Quality , 2006, The American surgeon.

[80]  Domenico Consoli,et al.  Risk factors and outcome of subtypes of ischemic stroke. Data from a multicenter multinational hospital-based registry. The European Community Stroke Project , 2006, Journal of the Neurological Sciences.

[81]  Maureen A. Smith,et al.  30-Day Survival and Rehospitalization for Stroke Patients According to Physician Specialty , 2006, Cerebrovascular Diseases.

[82]  S. Normand,et al.  An Administrative Claims Model Suitable for Profiling Hospital Performance Based on 30-Day Mortality Rates Among Patients With an Acute Myocardial Infarction , 2006, Circulation.

[83]  T. Osler,et al.  Impact of Changing the Statistical Methodology on Hospital and Surgeon Ranking: The Case of the New York State Cardiac Surgery Report Card , 2006, Medical care.

[84]  Zhi‐Jie Zheng,et al.  Characteristics of an “Ill-Defined” Diagnosis for Stroke: Opportunities for Improvement , 2006, Stroke.

[85]  Rose Wiles,et al.  Recovery plateau following stroke: Fact or fiction? , 2006, Disability and rehabilitation.

[86]  Cheryl Anderson,et al.  Benefits of comprehensive inpatient education and discharge planning combined with outpatient support in elderly patients with congestive heart failure. , 2005, Congestive heart failure.

[87]  Edward E. Packer “Opportunities” for Improvement , 2005 .

[88]  V. Salomaa,et al.  Diabetes worsens the outcome of acute ischemic stroke. , 2005, Diabetes research and clinical practice.

[89]  Maureen A. Smith,et al.  Rehospitalization and Survival for Stroke Patients in Managed Care and Traditional Medicare Plans , 2005, Medical care.

[90]  P. Austin,et al.  The Impact of Under Coding of Cardiac Severity and Comorbid Diseases on the Accuracy of Hospital Report Cards , 2005, Medical care.

[91]  S. Raudenbush,et al.  Predicting Risk-Adjusted Mortality for CABG Surgery: Logistic Versus Hierarchical Logistic Models , 2005, Medical care.

[92]  M. Hadley,et al.  Recommendations for Comprehensive Stroke Centers: A Consensus Statement From the Brain Attack Coalition , 2005, Stroke.

[93]  Kun-Yang Chuang,et al.  Identifying Factors Associated With Hospital Readmissions Among Stroke Patients in Taipei , 2005, The journal of nursing research : JNR.

[94]  Byron S Kennedy,et al.  Does race predict stroke readmission? An analysis using the truncated negative binomial model. , 2005, Journal of the National Medical Association.

[95]  Jan Potter,et al.  Reliability of the Modified Rankin Scale Across Multiple Raters: Benefits of a Structured Interview , 2005, Stroke.

[96]  T. Neumann-Haefelin,et al.  A Simple 3-Item Stroke Scale: Comparison With the National Institutes of Health Stroke Scale and Prediction of Middle Cerebral Artery Occlusion , 2005, Stroke.

[97]  D. Asch,et al.  The unintended consequences of publicly reporting quality information. , 2005, JAMA.

[98]  Peter Moyer,et al.  Recommendations for the Establishment of Stroke Systems of Care: Recommendations From the American Stroke Association’s Task Force on the Development of Stroke Systems , 2005, Circulation.

[99]  Peter Moyer,et al.  Recommendations for the Establishment of Stroke Systems of Care: Recommendations From the American Stroke Association’s Task Force on the Development of Stroke Systems , 2005, Circulation.

[100]  C. Warlow,et al.  Routine oral nutritional supplementation for stroke patients in hospital (FOOD): a multicentre randomised controlled trial , 2005, The Lancet.

[101]  P. Austin,et al.  Optimal Statistical Decisions for Hospital Report Cards , 2005, Medical decision making : an international journal of the Society for Medical Decision Making.

[102]  T. Rundek,et al.  Health Care Resource Use After Acute Stroke in the Glycine Antagonist in Neuroprotection (GAIN) Americas Trial , 2004, Stroke.

[103]  Richard W. Bohannon,et al.  Association of Physical Functioning with Same-Hospital Readmission After Stroke , 2004, American journal of physical medicine & rehabilitation.

[104]  Richard Lilford,et al.  Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma , 2004, The Lancet.

[105]  Pamela W. Duncan,et al.  Disability Measures in Stroke: Relationship Among the Barthel Index, the Functional Independence Measure, and the Modified Rankin Scale , 2004, Stroke.

[106]  Predicting outcome after acute ischemic stroke , 2004, Neurology.

[107]  A. Ziegler,et al.  Age and National Institutes of Health Stroke Scale Score Within 6 Hours After Onset Are Accurate Predictors of Outcome After Cerebral Ischemia: Development and External Validation of Prognostic Models , 2003, Stroke.

[108]  Peter C Austin,et al.  The Use of Fixed-and Random-Effects Models for Classifying Hospitals as Mortality Outliers: A Monte Carlo Assessment , 2003, Medical decision making : an international journal of the Society for Medical Decision Making.

[109]  Richard W. Bohannon,et al.  Hospital readmissions and deaths during the first year after hospitalization for stroke. , 2003, Connecticut medicine.

[110]  E. Yano,et al.  Smoking cessation care received by veterans with chronic obstructive pulmonary disease. , 2003, Journal of rehabilitation research and development.

[111]  C. Levi,et al.  A prediction model of 1-year mortality for acute ischemic stroke patients. , 2003, Archives of physical medicine and rehabilitation.

[112]  Nick Freemantle,et al.  Composite outcomes in randomized trials: greater precision but with greater uncertainty? , 2003, JAMA.

[113]  Ilmo Keskimäki,et al.  An international study of hospital readmissions and related utilization in Europe and the USA. , 2002, Health policy.

[114]  Christian Weimar,et al.  Assessment of Functioning and Disability After Ischemic Stroke , 2002, Stroke.

[115]  I. König,et al.  Predicting functional outcome and survival after acute ischemic stroke , 2002, Journal of Neurology.

[116]  C. Warlow,et al.  Predicting Outcome After Acute and Subacute Stroke: Development and Validation of New Prognostic Models , 2002, Stroke.

[117]  T O Tengs,et al.  Health-related quality of life after stroke a comprehensive review. , 2001, Stroke.

[118]  I. Bone,et al.  Prospective study of apolipoprotein E genotype and functional outcome following ischemic stroke. , 2000, Archives of neurology.

[119]  J. Tu,et al.  A Canadian comparison of data sources for coronary artery bypass surgery outcome "report cards". , 2000, American heart journal.

[120]  C B Granger,et al.  Risk stratification and therapeutic decision making in acute coronary syndromes. , 2000, JAMA.

[121]  L I Iezzoni,et al.  Identification of in-hospital complications from claims data. Is it valid? , 2000, Medical care.

[122]  D. Wade,et al.  Outcome measures in acute stroke trials: a systematic review and some recommendations to improve practice. , 2000, Stroke.

[123]  P. Duncan,et al.  Defining post-stroke recovery: implications for design and interpretation of drug trials , 2000, Neuropharmacology.

[124]  B. McNeil,et al.  Measuring and improving quality of care: a report from the American Heart Association/American College of Cardiology First Scientific Forum on Assessment of Healthcare Quality in Cardiovascular Disease and Stroke. , 2000, Circulation.

[125]  A. Dobson,et al.  Death and readmission in the year after hospital admission with cardiovascular disease: the Hunter Area Heart and Stroke Register , 2000, The Medical journal of Australia.

[126]  M. Naylor,et al.  Comprehensive discharge planning and home follow-up of hospitalized elders: a randomized clinical trial. , 1999, JAMA.

[127]  E. DeLong,et al.  Comparing risk-adjustment methods for provider profiling. , 1998, Statistics in medicine.

[128]  R. Kane,et al.  Functional Outcomes of Posthospital Care for Stroke and Hip Fracture Patients Under Medicare , 1998, Journal of the American Geriatrics Society.

[129]  C. Clancy,et al.  Outcomes Research: Measuring the End Results of Health Care , 1998, Science.

[130]  Tony Travers,et al.  A Comprehensive Review , 1998 .

[131]  A. Furlan,et al.  Is in-hospital stroke mortality an accurate measure of quality of care? , 1998, Neurology.

[132]  W G Cole,et al.  Validation of Preferences for Life-Sustaining Treatment: Implications for Advance Care Planning , 1997, Annals of Internal Medicine.

[133]  M. Glickman,et al.  Statistical Methods for Profiling Providers of Medical Care: Issues and Applications , 1997 .

[134]  G. Thibault,et al.  Discharge destination and repeat hospitalizations. , 1997, Medical care.

[135]  Zheng-Ming Chen,et al.  CAST: randomised placebo-controlled trial of early aspirin use in 20 000 patients with acute ischaemic stroke , 1997, The Lancet.

[136]  R Brown,et al.  A methodology for measuring clinical outcomes in an acute care teaching hospital. , 1996, Journal of quality in clinical practice.

[137]  C. Loeb,et al.  Value of early variables as predictors of short-term outcome in patients with acute focal cerebral ischemia , 1996, The Italian Journal of Neurological Sciences.

[138]  L I Iezzoni,et al.  Predicting In-hospital Mortality for Stroke Patients , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[139]  R. Hayward,et al.  Identifying poor-quality hospitals. Can hospital mortality rates detect quality problems for medical diagnoses? , 1996, Medical care.

[140]  J. Allison Risk adjustment for measuring health care outcomes , 1996 .

[141]  Harvey Goldstein,et al.  League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance , 1996 .

[142]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .

[143]  Joseph P. Broderick,et al.  Tissue plasminogen activator for acute ischemic stroke. The National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. , 1995 .

[144]  T. Olsen,et al.  Outcome and time course of recovery in stroke. Part II: Time course of recovery. The Copenhagen Stroke Study. , 1995, Archives of physical medicine and rehabilitation.

[145]  L. Iezzoni Risk Adjustment for Measuring Healthcare Outcomes , 1994 .

[146]  E. DeLong,et al.  Discordance of Databases Designed for Claims Payment versus Clinical Information Systems: Implications for Outcomes Research , 1993, Annals of Internal Medicine.

[147]  P. Duncan,et al.  Measurement of Motor Recovery After Stroke: Outcome Assessment and Sample Size Requirements , 1992, Stroke.

[148]  H. Schouten,et al.  Interobserver agreement for the assessment of handicap in stroke patients. , 1988, Stroke.

[149]  Zhao Jun Intepretation of 2010 VA/DoD clinical practice guideline for the management of stroke rehabilitation , 2013 .

[150]  Thomas A. Louis,et al.  Statistical Issues in Assessing Hospital Performance , 2012 .

[151]  D. Bild,et al.  Score What Makes a Good Predictor ? : The Evidence Applied to Coronary Artery Calcium , 2010 .

[152]  J. Hughes,et al.  Identifying Potentially Preventable Readmissions , 2008, Health care financing review.

[153]  Susan Bogasky Examining Relationships in an Integrated Hospital System , 2008 .

[154]  Peter Langhorne,et al.  Organised inpatient (stroke unit) care for stroke. , 2007, The Cochrane database of systematic reviews.

[155]  F Nemeth,et al.  End of life. , 2007, Bratislavske lekarske listy.

[156]  A. Wielgosz,et al.  Incidence, comorbidity, case fatality and readmission of hospitalized stroke patients in Canada. , 2006, The Canadian journal of cardiology.

[157]  M. Buntin,et al.  Effects of Payment Changes on Trends in Access to Post-Acute Care , 2005 .

[158]  A. Dromerick,et al.  Sensitivity to changes in disability after stroke: a comparison of four scales useful in clinical trials. , 2003, Journal of rehabilitation research and development.

[159]  P. Sandercock,et al.  Antiplatelet therapy for acute ischaemic stroke. , 2003, The Cochrane database of systematic reviews.

[160]  N. Goldfield,et al.  A closer look at all-patient refined DRGs. , 2002, Journal of AHIMA.

[161]  B. McNeil,et al.  Measuring and improving quality of care : A report from the american heart Association/American college of cardiology first scientific forum on assessment of healthcare quality in cardiovascular disease and stroke , 2000, Stroke.

[162]  J W Thomas,et al.  Accuracy of risk-adjusted mortality rate as a measure of hospital quality of care. , 1999, Medical care.

[163]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[164]  G A Diamond,et al.  What price perfection? Calibration and discrimination of clinical prediction models. , 1992, Journal of clinical epidemiology.

[165]  R. Bloch,et al.  Interobserver agreement for the assessment of handicap in stroke patients. , 1988, Stroke.