Feasibility, reliability, and validity of adolescent health status measurement by the Child Health Questionnaire Child Form (CHQ-CF): internet administration compared with the standard paper version

AimsIn this study we evaluated indicators of the feasibility, reliability, and validity of the Child Health Questionnaire-Child Form (CHQ-CF). We compared the results in a subgroup of adolescents who completed the standard paper version of the CHQ-CF with the results in another subgroup of adolescents who completed an internet version, i.e., an online, web-based CHQ-CF questionnaire.MethodsUnder supervision at school, 1,071 adolescents were randomized to complete the CHQ-CF and items on chronic conditions by a paper questionnaire or by an internet administered questionnaire.ResultsThe participation rate was 87%; age range 13–7 years. The internet administration resulted in fewer missing answers. All but one multi-item scale showed internal consistency reliability (Cronbach’s α > 0.70). All scales clearly discriminated between adolescents with no, a few, or many self-reported chronic conditions. The paper administration resulted in statistically significant, higher scores on 4 of 10 CHQ-CF scales compared with the internet administration (P < 0.05), but Cohen’s effect sizes d were ≤0.21. Mode of administration interacted significantly with age (P < 0.05) on four CHQ-CF scales, but Cohen’s effect sizes for these differences were also ≤0.21.ConclusionThis study supports the feasibility, internal consistency reliability of the scales, and construct validity of the CHQ-CF administered by either a paper questionnaire or online questionnaire. Given Cohen’s suggested guidelines for the interpretation of effect sizes, i.e., 0.20–.50 indicates a small effect, differences in CHQ-CF scale scores between paper and internet administration can be considered as negligible or small.

[1]  D. Battistutta,et al.  A comparison of costs and data quality of three health survey methods: mail, telephone and personal home interview. , 1986, American journal of epidemiology.

[2]  D. Altman,et al.  Statistics notes: Cronbach's alpha , 1997 .

[3]  H L MacMillan,et al.  Computer survey technology: a window on sensitive issues. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[4]  Olle Bälter,et al.  Web-based and Mailed Questionnaires: A Comparison of Response Rates and Compliance , 2005, Epidemiology.

[5]  C. McHorney,et al.  Comparisons of the Costs and Quality of Norms for the SF-36 Health Survey Collected by Mail Versus Telephone Interview: Results From a National Survey , 1994, Medical care.

[6]  New technology in quality of life research: Are all computer-assisted approaches created equal? , 2003, Quality of Life Research.

[7]  D E Bloom,et al.  Technology, Experimentation, and the Quality of Survey Data , 1998, Science.

[8]  L. Abetz,et al.  Functional status and well-being of children representing three cultural groups: Initial self-reports using the chq-cf87 , 1997 .

[9]  J. Fortenberry,et al.  Comparability of a computer-assisted versus written method for collecting health behavior information from adolescent patients. , 1999, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[10]  S. Cavuto,et al.  Cross-cultural adaptation and psychometric evaluation of the Childhood Health Assessment Questionnaire (CHAQ) and the Child Health Questionnaire (CHQ) in 32 countries. Review of the general methodology. , 2001, Clinical and experimental rheumatology.

[11]  M. Bayliss,et al.  A study of the feasibility of Internet administration of a computerized health survey: The headache impact test (HIT™) , 2003, Quality of Life Research.

[12]  Kate Lorig,et al.  Internet Versus Mailed Questionnaires: A Randomized Comparison , 2004, Journal of medical Internet research.

[13]  J. Huisman The Netherlands , 1996, The Lancet.

[14]  Harry J de Koning,et al.  Internet versus paper mode of health and health behavior questionnaires in elementary schools: asthma and fruit as examples. , 2006, The Journal of school health.

[15]  R M Weiler,et al.  The Feasibility of a Web-Based Surveillance System to Collect Health Risk Behavior Data from College Students , 2001, Health education & behavior : the official publication of the Society for Public Health Education.

[16]  M. Schonlau,et al.  Will Web Surveys Ever Become Part of Mainstream Research? , 2004, Journal of medical Internet research.

[17]  G. Norman,et al.  Interpretation of Changes in Health-related Quality of Life: The Remarkable Universality of Half a Standard Deviation , 2003, Medical care.

[18]  S. M. Rogers,et al.  Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. , 1998, Science.

[19]  H. Raat,et al.  Pediatric health-related quality of life questionnaires in clinical trials , 2006, Current opinion in allergy and clinical immunology.

[20]  Ernst Wit,et al.  Statistics for Microarrays : Design, Analysis and Inference , 2004 .

[21]  Ernst Wit,et al.  Statistics for microarrays , 2004 .

[22]  Don Gosselin PHP Programming with MySQL , 2005 .

[23]  A. Bowling Mode of questionnaire administration can have serious effects on data quality. , 2005, Journal of public health.

[24]  N. Leidy,et al.  A Comparative Trial of Paper-and-Pencil Versus Computer Administration of the Quality of Life in Reflux and Dyspepsia (QOLRAD) Questionnaire , 2001, Medical care.

[25]  G. Bonsel,et al.  Reliability and validity of the child health questionnaire-child form (CHQ-CF87) in a Dutch adolescent population , 2002, Quality of Life Research.

[26]  Michael J. Burke,et al.  Averaging Correlations: Expected Values and Bias in Combined Pearson rs and Fisher's z Transformations , 1998 .

[27]  Erik Cobo,et al.  Efficiency of the cross‐over design: an empirical estimation , 2004, Statistics in medicine.

[28]  E. Waters,et al.  The health and well-being of adolescents: a school-based population study of the self-report Child Health Questionnaire. , 2001, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[29]  Noel T Brewer,et al.  Why Do People Report Better Health by Phone Than by Mail? , 2004, Medical care.

[30]  H. D. de Koning,et al.  Internet-administered adolescent health questionnaires compared with a paper version in a randomized study. , 2005, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[31]  Seonghoon Kim,et al.  Testing the Difference Between Two Alpha Coefficients With Small Samples of Subjects and Raters , 2006 .

[32]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[33]  Robyn Attewell,et al.  A comparison of an electronic version of the SF-36 General Health Questionnaire to the standard paper version , 2002, Quality of Life Research.

[34]  J. van der Lei,et al.  Internet and written respiratory questionnaires yield equivalent results for adolescents , 2007, Pediatric pulmonology.