Achieving Consensus Across Diverse Stakeholders on Quality Measures for Mental Healthcare

Objective:Quality-improvement efforts are hindered by a lack of consensus on meaningful and feasible measures of care. The objective of this study was to develop a core set of quality measures for mental health and substance-related care that are meaningful to stakeholders, feasible to implement, and broadly representative of diverse dimensions of the mental health system. Method:A 12-member panel of stakeholders from national organizations evaluated 116 process measures in a 2-stage modified Delphi consensus development process. Drawing on a conceptual framework and literature review, panelists rated each measure on 7 domains using a 9-point scale (1 = best). Measures were then mapped to a framework of system dimensions to identify a core set with the highest ratings for system characteristics within each dimension. Results:Twenty-eight measures were identified assessing treatment (12), access (2), assessment (2), continuity (4), coordination (2), prevention (1), and safety (5). Overall, mean ratings for meaningfulness were: clinical importance 2.29; perceived gap between actual and optimal care 2.59; association between improved performance and outcome 2.61. For feasibility, mean ratings were clarity of specifications 3.39; acceptability of data collection burden 4.77; and adequacy of case mix adjustment 4.20. The measures address a range of treatment modalities, clinical settings, diagnostic categories, vulnerable populations, and other dimensions of mental healthcare. Conclusions:A structured consensus process identified a core set of quality measures that are meaningful and feasible to multiple stakeholders, as well as broadly representative of the mental healthcare system. By yielding quantitative assessments of meaningfulness, feasibility and degree of consensus among stakeholders, these results can inform ongoing national efforts to adopt common quality measures for mental healthcare.

[1]  L. E. Peterson,et al.  Eliciting expert opinion using the Delphi technique: identifying performance indicators for cardiovascular disease. , 1998, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[2]  R. Palmer,et al.  Common ground: a framework for selecting core quality measures for mental health and substance abuse care. , 2002, Psychiatric services.

[3]  J. Allison.  Risk adjustment for measuring health care outcomes , 1996 .

[4]  F. Sainfort,et al.  Development and Testing of Nursing Home Quality Indicators , 1995, Health care financing review.

[5]  D M Steinwachs,et al.  Patterns of usual care for schizophrenia: initial results from the Schizophrenia Patient Outcomes Research Team (PORT) Client Survey. , 1998, Schizophrenia bulletin.

[6]  C. Bush,et al.  Excerpts from the report of the surgeon general's conference on children's mental health: a national action agenda. , 2001, Journal of child and adolescent psychiatric nursing : official publication of the Association of Child and Adolescent Psychiatric Nurses, Inc.

[7]  R. Rosenheck,et al.  Comparing quality of mental health care for public-sector and privately insured populations. , 2000, Psychiatric services.

[8]  K. Kahn,et al.  Quality of antidepressant medications prescribed at discharge to depressed elderly patients in general medical hospitals before and after prospective payment system. , 1994, General Hospital Psychiatry.

[9]  R H Brook,et al.  Measuring the quality of outpatient treatment for schizophrenia. , 1998, Archives of general psychiatry.

[10]  D. Kupfer,et al.  Therapeutic drug monitoring of mood stabilizers in Medicaid patients with bipolar disorder. , 1999, The American journal of psychiatry.

[11]  Performance measures for managed behavioral healthcare programs. , 1996, Behavioral healthcare tomorrow.

[12]  J. Eisenberg.  Agency for Health Care Policy and Research. , 1999, Medical care.

[13]  Nan D. Hunter.  Quality first: better health care for all Americans. , 1998, The Kansas nurse.

[14]  C. Weisman,et al.  Performance indicators in women's health: incorporating women's health in the health plan employer data and information set (HEDIS). , 2002, Women's health issues : official publication of the Jacobs Institute of Women's Health.

[15]  D. Gifford,et al.  Development of a quality of care measurement system for children and adolescents. Methodological considerations and comparisons with a system for adult women. , 1997, Archives of pediatrics & adolescent medicine.

[16]  L. Schacht,et al.  Recent applications of risk adjustment for performance measures used by state inpatient psychiatric facilities. , 2003, Harvard review of psychiatry.

[17]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[18]  D. Gastfriend,et al.  Developing performance measures for alcohol and other drug services in managed care plans. Washington Circle Group. , 2000, The Joint Commission journal on quality improvement.

[19]  C. Patterson.  Joint Commission on Accreditation of Healthcare Organizations , 1995, Infection Control & Hospital Epidemiology.

[20]  P Lapuerta,et al.  A new approach for measuring quality of care for women with hypertension. , 2001, Archives of internal medicine.

[21]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[22]  M. Finnerty,et al.  Process measures for the assessment and improvement of quality of care for schizophrenia. , 2002, Schizophrenia bulletin.

[23]  H. S. Leff,et al.  Quality measures for mental health care: results from a national inventory. , 2000, Medical care research and review : MCRR.

[24]  Janet M. Corrigan,et al.  Envisioning the national health care quality report , 2001 .