Effects of mode of administration (MOA) on the measurement properties of the EORTC QLQ-C30: a randomized study

BackgroundWhile modern electronic data collection methods (e.g., computer touch-screen or web-based) hold much promise, most current studies continue to make use of more traditional data collection techniques, including paper-and-pencil administration and telephone interviews. The present randomized trial investigated the measurement properties of the EORTC QLQ-C30 under three different modes of administration (MOA's).MethodsA heterogeneous sample of 314 cancer patients undergoing treatment at a specialized treatment center in Amsterdam were randomized to one of three MOA's for the QLQ-C30: paper-and-pencil at home via the mail, telephone interview, and paper-and-pencil at the hospital clinic. Group differences in internal consistency reliabilities (Cronbach's alpha coefficient) for the scale scores were compared. Differences in mean scale scores were also compared by means of ANOVA, with adjustment for potential confounders.ResultsOnly one statistically significant, yet minor, difference in Cronbach's alpha between the MOA groups was observed for the Role Functioning scale (all 3 alphas >0.80). Significant differences in group means -after adjustment- were found for the Emotional Functioning (EF) scale. Patients completing the written questionnaire at home had significantly lower levels of EF as compared to those interviewed via the telephone; EF scores of those completing the questionnaire at the clinic fell in-between those of the other two groups. These differences, however, were small in magnitude.ConclusionsMOA had little effect on the reliability or the mean scores of the EORTC QLQ-C30, with the possible exception of the EF scale.

[1]  B. Spilker,et al.  Quality of life and pharmacoeconomics in clinical trials , 1996 .

[2]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[3]  Andrew Bottomley,et al.  EORTC QLQ-C30 Scoring Manual , 1995 .

[4]  M Tubiana,et al.  The European Organization for Research and Treatment of Cancer (EORTC). , 1988, International journal of radiation oncology, biology, physics.

[5]  B. Winblad,et al.  Memory Complaints of Elderly People in a Population Survey: Variation According to Dementia Stage and Depression , 1993, Journal of the American Geriatrics Society.

[6]  Christopher J. McCarthy,et al.  Paper-and-Pencil Or Online? , 2002, Assessment.

[7]  D. Forman,et al.  Automated collection of quality-of-life data: a comparison of paper and computer touch-screen questionnaires. , 1999, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[8]  Colin M. MacLeod,et al.  Evaluation of chemotherapeutic agents , 1949 .

[9]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[10]  N. Aaronson,et al.  Feasibility, psychometric performance, and stability across modes of administration of the CARES-SF. , 1996, Annals of Oncology.

[11]  R W Sanson-Fisher,et al.  An examination of self- and telephone-administered modes of administration for the Australian SF-36. , 1998, Journal of clinical epidemiology.

[12]  Lea Maes,et al.  Comparison of a computer-administered and paper-and-pencil-administered questionnaire on health and lifestyle behaviors. , 2006, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[13]  G. Lautenschlager ALPHATST: Testing for Differences in Values of Coefficient Alpha , 1989 .

[14]  A. Wu,et al.  The effect of mode of administration on Medical Outcomes Study health ratings and EuroQol scores in AIDS , 2004, Quality of Life Research.

[15]  D. Osoba,et al.  Modification of the EORTC QLQ-C30 (version 2.0) based on content validity and reliability testing in large samples of patients with cancer , 1997, Quality of Life Research.

[16]  S. Fosså,et al.  Test/retest study of the European Organization for Research and Treatment of Cancer Core Quality-of-Life Questionnaire. , 1995, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[17]  Julian Thumboo,et al.  Quality of life scores differed according to mode of administration in a review of three major oncology questionnaires. , 2006, Journal of clinical epidemiology.

[18]  D. Karnofsky The clinical evaluation of chemotherapeutic agents in cancer , 1949 .

[19]  H A Guess,et al.  Does the mode of questionnaire administration affect the reporting of urinary symptoms? , 1995, Urology.

[20]  D. Osoba,et al.  Interpreting the significance of changes in health-related quality-of-life scores. , 1998, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  D. Osoba,et al.  The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. , 1993, Journal of the National Cancer Institute.

[22]  H. Cohen,et al.  Assessing Health‐Related Quality of Life in Elderly Outpatients: Telephone Versus Face‐to‐Face Administration , 1994, Journal of the American Geriatrics Society.

[23]  G P Samsa,et al.  Are health-related quality-of-life measures affected by the mode of administration? , 1996, Journal of clinical epidemiology.

[24]  L. von Essen,et al.  Measuring health-related quality of life in adolescents and young adults: Swedish normative data for the SF-36 and the HADS, and the influence of age, gender, and method of administration , 2006, Health and quality of life outcomes.

[25]  S. Kaasa,et al.  The European Organisation for Research and Treatment of Cancer (EORTC) modular approach to quality of life assessment in oncology: an update. , 1995 .

[26]  M. Stek,et al.  The American Urological Association symptom index: does mode of administration affect its psychometric properties? , 1995, The Journal of urology.