Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures.

OBJECTIVE This study was aimed to develop a tool for the standardized assessment of patient-reported outcomes (PROs) to assist the choice of instruments. METHODS An expert panel adapted the eight attributes proposed by the Medical Outcomes Trust as evaluation review criteria, created items to evaluate them, and included a response scale for each item. A pilot test was designed to test the new tool's feasibility and to obtain preliminary information concerning its psychometric properties. The Spanish versions of five measures were selected for assessment: the SF-36 Health Survey, the Nottingham Health Profile, the COOP-WONCA charts, the EuroQol-5D, and the Quality of Life Questionnaire EORTC-QLQ-C30. We assessed the new tool's reliability (Cronbach's alpha and intraclass correlation coefficient [ICC]) and construct validity. RESULTS The new EMPRO (Evaluating the Measurement of Patient-Reported Outcomes) tool has 39 items covering eight key attributes: conceptual and measurement model, reliability, validity, responsiveness, interpretability, burden, alternative modes of administration, and cross-cultural and linguistic adaptations. Internal consistency was high (alpha = 0.95) as was interrater concordance (ICC: 0.87-0.94). Positive associations consistent with a priori hypotheses were observed between EMPRO attribute scores and the number of articles identified for the measures, the years elapsed since the publication of the first article, and the number of citations. CONCLUSION A new tool for the standardized assessment of PRO measures is available. It has shown good preliminary reliability and validity and should be a useful aid to investigators who need to choose between alternative measures. Further assessment of the tool is necessary.

[1]  D. Streiner,et al.  Health measurement scales , 2008 .

[2]  G. Guyatt,et al.  The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature , 2008, Quality of Life Research.

[3]  Jose M Valderas,et al.  Construcción de un filtro geográfico para la identificación en PubMed de estudios realizados en España , 2006 .

[4]  R. Hays,et al.  Classical Test Theory and Item Response Theory Analyses of Multi-Item Scales Assessing Parents' Perceptions of Their Children's Dental Care , 2006, Medical care.

[5]  J. Müller-Nordhorn.  Assessing quality of life in clinical trials, 2nd ed , 2006 .

[6]  T. Mills,et al.  Measuring Health: A Guide to Rating Scales and Questionnaires , 2006 .

[7]  W. Gaebel,et al.  Schizophrenia practice guidelines: international survey and comparison. , 2005, The British journal of psychiatry : the journal of mental science.

[8]  M. Offringa,et al.  Quality of Evidence-Based Pediatric Guidelines , 2005, Pediatrics.

[9]  C. Acquadro,et al.  Patient-Reported Outcome and Quality of Life Instruments Database (PROQOLID): Frequently asked questions , 2005, Health and quality of life outcomes.

[10]  R. Willke,et al.  Measuring treatment impact: a review of patient-reported outcomes and other efficacy endpoints in approved product labels. , 2004, Controlled clinical trials.

[11]  T Philip,et al.  International assessment of the quality of clinical practice guidelines in oncology using the Appraisal of Guidelines and Research and Evaluation Instrument. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[12]  N. Leidy,et al.  Incorporating the patient's perspective into drug development and communication: an ad hoc task force report of the Patient-Reported Outcomes (PRO) Harmonization Group meeting at the Food and Drug Administration, February 16, 2001. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[13]  R. Fitzpatrick,et al.  Quality of life measurement: bibliographic study of patient assessed health outcome measures , 2002, BMJ : British Medical Journal.

[14]  Kathleenl N. Lohr,et al.  Assessing health status and quality-of-life instruments: Attributes and review criteria , 2002, Quality of Life Research.

[15]  X. Badia,et al.  Cuestionarios de salud en España y su uso en atención primaria , 2001 .

[16]  J. Alonso.  La Medida de la Calidad de Vida Relacionada con la Salud en la Investigación y la Práctica Clínica , 2000 .

[17]  A. R. Ferrer,et al.  Adaptación transcultural de una medida de la calidad de vida relacionada con la salud: la versión española de las viñetas COOP/WONCA , 1999 .

[18]  L. Prieto,et al.  La evaluación de la fiabilidad en las observaciones clínicas: el coeficiente de correlación intraclase , 1998 .

[19]  K N Lohr,et al.  Evaluating quality-of-life and health status instruments: development of scientific review criteria. , 1996, Clinical therapeutics.

[20]  C. McHorney,et al.  Individual-patient monitoring in clinical practice: are available health status surveys adequate? , 1995, Quality of Life Research.

[21]  Ann Bowling,et al.  Measuring Disease: A Review of Disease-specific Quality of Life Measurement Scales (second edition) , 1995, Quality of Life Research.

[22]  D. Osoba,et al.  Letters to the editor: Assessing quality of life in clinical trials , 1993 .

[23]  D. Osoba,et al.  The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. , 1993, Journal of the National Cancer Institute.

[24]  J. Antó,et al.  Spanish version of the Nottingham Health Profile: translation and preliminary validity. , 1990, American journal of public health.

[25]  R. Angel,et al.  Self-rated health and mortality in the NHANES-I Epidemiologic Follow-up Study. , 1990, American journal of public health.

[26]  J. Philbrick,et al.  Health Perceptions of Primary Care Patients and the Influence on Health Care Utilization , 1989, Medical care.

[27]  J. Mcewen,et al.  The development of a subjective health indicator. , 1980, Sociology of health & illness.

[28]  C. Terwee,et al.  Quality criteria were proposed for measurement properties of health status questionnaires. , 2007, Journal of clinical epidemiology.

[29]  Joan Mendivil,et al.  [Development of a geographic filter for PubMed to identify studies performed in Spain]. , 2006, Revista espanola de cardiologia.

[30]  F. Cluzeau,et al.  Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project , 2003 .

[31]  N. Klazinga,et al.  Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project [AGREE] , 2003 .

[32]  S. Salek.  Compendium of quality of life instruments , 1998 .

[33]  L. Tudela.  Adaptacion de una medida de la calidad de vida relacionada con la salud en atencion primaria: la version española de las viñetas coop/wonca , 1997 .

[34]  E. Fernández,et al.  Influence of socio-demographic and health status variables on evaluation of health states in a Spanish population , 1995 .

[35]  J. I. A. Urdániz,et al.  El Cuestionario de Calidad de Vida para cáncer de la EORTC, QLQ-C30. Estudio estadístico de validación con una muestra española , 1995 .

[36]  Ware J.E.Jr.,et al.  THE MOS 36- ITEM SHORT FORM HEALTH SURVEY (SF- 36) CONCEPTUAL FRAMEWORK AND ITEM SELECTION , 1992 .

[37]  A. Williams.  EuroQol : a new facility for the measurement of health-related quality of life , 1990 .

[38]  A. Stewart,et al.  Assessment of function in routine clinical practice: description of the COOP Chart method and preliminary findings. , 1987, Journal of chronic diseases.