Stroke Care: A Method for Measuring Compliance with AHCPR Guidelines

LaClair BJ, Reker DM, Duncan PW, Horner RD, Hoenig H: Stroke care: A method for measuring compliance with AHCPR guidelines. Am J Phys Med Rehabil 2001;80:235–242.The purpose of this article is to describe a method for converting practice guidelines to measurement criteria. To evaluate the processes of care received by patients with stroke at 11 Veteran’s Administration hospital sites, we developed a measurement system based on Agency for Health Care Policy and Research (AHCPR) Post-Stroke Rehabilitation Clinical Practice Guidelines. Guideline recommendations were used as the framework for identifying important dimensions of care, and for developing chart abstraction instruments for both the acute and postacute settings. Using a modified Delphi technique to solicit opinions from an expert panel, a method was developed for aggregation of item-level chart abstraction components to overall guideline compliance scores. The measurement system was shown to have good-to-excellent intrarater and interrater reliability at the item, dimension, and overall compliance score levels. Abstraction of a sample of 100 medical records demonstrated the ability of the instruments to detect variability in processes of post-stroke care. This study provides the foundation for future research, which will evaluate associations between processes of post-stroke care, as measured by this medical chart abstraction system, and patient outcomes. (All abstraction instruments, criteria, and scoring algorithms described in this article are available for download at http://www2.kumc.edu/coa.)

[1]  F. Rivara.  Are Guidelines Following Guidelines , 1999 .

[2]  M. Mayo-Smith,et al.  Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. , 1999, JAMA.

[3]  S. Woolf,et al.  Do clinical practice guidelines define good medical care? The need for good science and the disclosure of uncertainty when defining 'best practices'. , 1998, Chest.

[4]  P. Duncan,et al.  Review criteria for stroke rehabilitation outcomes. , 1997, Archives of physical medicine and rehabilitation.

[5]  P. Mudge,et al.  Assessing case records using monitor criteria developed from consensus guidelines. , 1997, Australian family physician.

[6]  Catherine Ann Kernich,et al.  Post Stroke Rehabilitation, Clinical Practice Guideline, Number 16 , 1996 .

[7]  D. Baker,et al.  Phase II of the AHCPR-sponsored heart failure guideline: translating practice recommendations into review criteria. , 1996, The Joint Commission journal on quality improvement.

[8]  C. van Weel,et al.  Implementing guidelines in general practice. Evaluation of process and outcome of care in chronic diseases. , 1994, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[9]  S. Woolf.  Practice guidelines, a new reality in medicine. II. Methods of developing guidelines. , 1992, Archives of internal medicine.

[10]  M. Field,et al.  Clinical practice guidelines : directions for a new program , 1990 .

[11]  R. Brook,et al.  Consensus methods: characteristics and guidelines for use. , 1984, American journal of public health.

[12]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[13]  A V Milholland,et al.  Medical assessment by a Delphi group opinion technic. , 1973, The New England journal of medicine.

[14]  José Maria Paganni,et al.  Evaluating the quality of medical care. , 1966, The Milbank Memorial Fund quarterly.