Quality Control Process for EQ-5D-5L Valuation Studies.

BACKGROUND The values of the five-level EuroQol five-dimensional questionnaire (EQ-5D-5L) are elicited using composite time trade-off and discrete choice experiments. Unfortunately, data quality issues and interviewer effects were observed in the first few EQ-5D-5L valuation studies. To prevent these issues from occurring in later studies, the EuroQol Group established a cyclic quality control (QC) process. OBJECTIVES To describe this QC process and show its impact on data quality. METHODS A newly developed QC tool provided information about protocol compliance, interviewer effects, and mean values by health state severity. In a cyclic process, this information is initially used to evaluate whether new interviewers meet minimal quality requirements and later to provide feedback about how their performance may be improved. To investigate the impact of this cyclic process, we compared the quality of the data in Dutch and Spanish valuation studies that did not have this QC process with that in the follow-up studies in the same countries that used the QC process. Data quality was measured using protocol violations, variability between interviewers, the proportion of inconsistent responders, and clustering of composite time trade-off values. RESULTS In Spain, protocol violations were reduced from 87% in the valuation study to 5% in the follow-up study and in the Netherlands from 20% to 8%. In both countries, interviewers performed more homogeneously in the follow-up studies. The number of inconsistent respondents was reduced by 23.2% in Spain and 23.6% in the Netherlands. Values were less clustered in the follow-up studies. CONCLUSIONS The implementation of a strict QC process in EQ-5D-5L valuation studies increases interviewer protocol compliance and promotes data quality.

[1]  Mark Oppe,et al.  A program of methodological research to arrive at the new international EQ-5D-5L valuation protocol. , 2014, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[2]  G. S. Radford,et al.  The control of quality in manufacturing , 2007 .

[3]  Mark Oppe,et al.  Lead versus lag time trade-off variants: does it make any difference? , 2013 .

[4]  Nan Luo,et al.  The effects of lead time and visual aids in TTO valuation: a study of the EQ-VT framework , 2013, The European Journal of Health Economics.

[5]  Elvin Geng,et al.  Implementation and Operational Research: Evaluating Outcomes of Patients Lost to Follow-up in a Large Comprehensive Care Treatment Program in Western Kenya , 2015, Journal of acquired immune deficiency syndromes.

[6]  N. Devlin,et al.  The development of new research methods for the valuation of EQ-5D-5L , 2013, The European Journal of Health Economics.

[7]  M. Versteegh,et al.  Introducing the composite time trade-off: a test of feasibility and face validity , 2013, The European Journal of Health Economics.

[8]  Mark Oppe,et al.  EuroQol Protocols for Time Trade-Off Valuation of Health Outcomes , 2016, PharmacoEconomics.

[9]  Aki Tsuchiya,et al.  A comparison of alternative variants of the lead and lag time TTO. , 2013, Health economics.

[10]  G. Bonsel,et al.  Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L) , 2011, Quality of Life Research.

[11]  David Parkin,et al.  Patient-reported outcome measures in the NHS: new methods for analysing and reporting EQ-5D data. , 2010, Health economics.

[12]  E van der Schueren,et al.  Quality control of validity of data collected in clinical trials. EORTC Study Group on Data Management (SGDM). , 1989, European journal of cancer & clinical oncology.

[13]  Juan M Ramos-Goñi,et al.  Does the Introduction of the Ranking Task in Valuation Studies Improve Data Quality and Reduce Inconsistencies? The Case of the EQ-5D-5L. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[14]  M De Pauw Quality control in data monitoring of clinical trials. , 1994, Acta urologica Belgica.

[15]  Mark Oppe,et al.  Valuation and Modeling of EQ-5D-5L Health States Using a Hybrid Approach , 2014, Medical care.

[16]  G. Knatterud,et al.  Methods of quality control and of continuous audit procedures for controlled clinical trials. , 1981, Controlled clinical trials.

[17]  Angela Robinson,et al.  Exploring challenges to TTO utilities: valuing states worse than dead. , 2006, Health economics.

[18]  Jan Passchier,et al.  Employing quality control and feedback to the EQ-5D-5L valuation protocol to improve the quality of data collection , 2016, Quality of Life Research.

[19]  G Ardine de Wit,et al.  Dutch Tariff for the Five-Level Version of EQ-5D. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.