Employing quality control and feedback to the EQ-5D-5L valuation protocol to improve the quality of data collection

ObjectivesIn valuing health states using generic questionnaires such as EQ-5D, there are unrevealed issues with the quality of the data collection. The aims were to describe the problems encountered during valuation and to evaluate a quality control report and subsequent retraining of interviewers in improving this valuation.MethodsData from the first 266 respondents in an EQ-5D-5L valuation study were used. Interviewers were trained and answered questions regarding problems during these initial interviews. Thematic analysis was used, and individual feedback was provided. After completion of 98 interviews, a first quantitative quality control (QC) report was generated, followed by a 1-day retraining program. Subsequently individual feedback was also given on the basis of follow-up QCs. The Wilcoxon signed-rank test was used to assess improvements based on 7 indicators of quality as identified in the first QC and the QC conducted after a further 168 interviews.ResultsInterviewers encountered problems in recruiting respondents. Solutions provided were: optimization of the time of interview, the use of broader networks and the use of different scripts to explain the project’s goals to respondents. For problems in interviewing process, solutions applied were: developing the technical and personal skills of the interviewers and stimulating the respondents’ thought processes. There were also technical problems related to hardware, software and internet connections. There was an improvement in all 7 indicators of quality after the second QC.ConclusionTraining before and during a study, and individual feedback on the basis of a quantitative QC, can increase the validity of values obtained from generic questionnaires.

[1]  Mark Oppe,et al.  Lead versus lag time trade-off variants: does it make any difference? , 2013 .

[2]  Juan Manuel Ramos-Goñi,et al.  Erratum to: An EQ-5D-5L value set based on Uruguayan population preferences , 2015, Quality of Life Research.

[3]  Urip Purwono,et al.  Indonesian adolescents' spiritual and religious experiences and their longitudinal relations with socioemotional functioning. , 2010, Developmental psychology.

[4]  N. Bansback,et al.  A Time Trade-off-derived Value Set of the EQ-5D-5L for Canada , 2015, Medical care.

[5]  Elizabeth Burgess-Pinto,et al.  Challenges and Approaches to Newcomer Health Research , 2008, Journal of transcultural nursing : official journal of the Transcultural Nursing Society.

[6]  G Ardine de Wit,et al.  Dutch Tariff for the Five-Level Version of EQ-5D. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[7]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[8]  Nan Luo,et al.  Mapping and direct valuation: do they give equivalent EQ-5D-5L index scores? , 2015, Health and Quality of Life Outcomes.

[9]  Mark Oppe,et al.  A program of methodological research to arrive at the new international EQ-5D-5L valuation protocol. , 2014, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[10]  Donald E. Stem,et al.  Respondent Anxiety Reduction With the Randomized Response Technique , 1988 .

[11]  W Kaiser,et al.  [Interviewer effects in assessing subjective quality of life and satisfaction with care in sheltered housing]. , 1998, Psychiatrische Praxis.

[12]  Koonal Shah,et al.  An Investigation of the Feasibility and Cultural Appropriateness of Stated Preference Methods to Generate EQ-5D-5L Values in the United Arab Emirates , 2015 .

[13]  S. Mackintosh,et al.  Qualitative studies using in-depth interviews with older people from multiple language groups: methodological systematic review. , 2012, Journal of advanced nursing.

[14]  Juan Manuel Ramos-Goñi,et al.  An EQ-5D-5L value set based on Uruguayan population preferences , 2016, Quality of Life Research.

[15]  Aki Tsuchiya,et al.  Testing a discrete choice experiment including duration to value health states for large descriptive systems: Addressing design and sampling issues , 2014, Social science & medicine.

[16]  Mark Oppe,et al.  One-to-one versus group setting for conducting computer-assisted TTO studies: findings from pilot studies in England and the Netherlands , 2013, The European Journal of Health Economics.

[17]  Brendan Mulhern,et al.  Valuing health‐related quality of life: An EQ‐5D‐5L value set for England , 2017, Health economics.

[18]  Takashi Fukuda,et al.  Developing a Japanese version of the EQ-5D-5L value set , 2015 .

[19]  Mark Oppe,et al.  Introducing the composite time trade-off: a test of feasibility and face validity , 2013, The European Journal of Health Economics.

[20]  Nan Luo,et al.  Validity, feasibility and acceptability of time trade-off and standard gamble assessments in health valuation studies: a study in a multiethnic Asian population in Singapore. , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[21]  S. Galea,et al.  Participation rates in epidemiologic studies. , 2007, Annals of epidemiology.

[22]  A. Kroeger,et al.  Health interview surveys in developing countries: a review of the methods and results. , 1983, International journal of epidemiology.

[23]  Mark Oppe,et al.  Lead versus lag-time trade-off variants: does it make any difference? , 2013, The European Journal of Health Economics.

[24]  M. Patton Qualitative research & evaluation methods , 2002 .

[25]  Anne M Stiggelbout,et al.  Qualitative and Quantitative Analysis of Interviewer Help Answering the Time Tradeoff , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  T. Kohlmann,et al.  Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[27]  A. Goh,et al.  Estimating an EQ-5D value set for Malaysia using time trade-off and visual analogue scale methods. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[28]  Nan Luo,et al.  The EQ-5D-5L valuation study in Korea , 2016, Quality of Life Research.

[29]  G. Bonsel,et al.  Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L) , 2011, Quality of Life Research.

[30]  Colin Sharp Qualitative Research and Evaluation Methods (3rd ed.) , 2003 .

[31]  Mark Oppe,et al.  Valuation and Modeling of EQ-5D-5L Health States Using a Hybrid Approach , 2014, Medical care.

[32]  K. Perampaladas,et al.  Comparing EQ-5D valuation studies: A systematic review and methodological reporting checklist , 2013 .

[33]  Lin Fritschi,et al.  Why Do People Participate in Epidemiological Research? , 2015, Journal of Bioethical Inquiry.