Volunteer Bias in Recruitment, Retention, and Blood Sample Donation in a Randomised Controlled Trial Involving Mothers and Their Children at Six Months and Two Years: A Longitudinal Analysis

Background The vulnerability of clinical trials to volunteer bias is under-reported. Volunteer bias is systematic error due to differences between those who choose to participate in studies and those who do not. Methods and Results This paper extends the applications of the concept of volunteer bias by using data from a trial of probiotic supplementation for childhood atopy in healthy dyads to explore 1) differences between a) trial participants and aggregated data from publicly available databases b) participants and non-participants as the trial progressed 2) impact on trial findings of weighting data according to deprivation (Townsend) fifths in the sample and target populations. 1) a) Recruits (n = 454) were less deprived than the target population, matched for area of residence and delivery dates (n = 6,893) (mean [SD] deprivation scores 0.09[4.21] and 0.79[4.08], t = 3.44, df = 511, p<0.001). b) i)As the trial progressed, representation of the most deprived decreased. These participants and smokers were less likely to be retained at 6 months (n = 430[95%]) (OR 0.29,0.13–0.67 and 0.20,0.09–0.46), and 2 years (n = 380[84%]) (aOR 0.68,0.50–0.93 and 0.55,0.28–1.09), and consent to infant blood sample donation (n = 220[48%]) (aOR 0.72,0.57–0.92 and 0.43,0.22–0.83). ii)Mothers interested in probiotics or research or reporting infants’ adverse events or rashes were more likely to attend research clinics and consent to skin-prick testing. Mothers participating to help children were more likely to consent to infant blood sample donation. 2) In one trial outcome, atopic eczema, the intervention had a positive effect only in the over-represented, least deprived group. Here, data weighting attenuated risk reduction from 6.9%(0.9–13.1%) to 4.6%(−1.4–+10.5%), and OR from 0.40(0.18–0.91) to 0.56(0.26–1.21). Other findings were unchanged. Conclusions Potential for volunteer bias intensified during the trial, due to non-participation of the most deprived and smokers. However, these were not the only predictors of non-participation. Data weighting quantified volunteer bias and modified one important trial outcome. Trial Registration This randomised, double blind, parallel group, placebo controlled trial is registered with the International Standard Randomised Controlled Trials Register, Number (ISRCTN) 26287422. Registered title: Probiotics in the prevention of atopy in infants and children.

[1]  A. Magarey,et al.  Recruiting and engaging new mothers in nutrition research studies: lessons from the Australian NOURISH randomised controlled trial , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[2]  Gordon H Guyatt,et al.  Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review , 2012, BMJ : British Medical Journal.

[3]  Duolao Wang,et al.  Probiotics and atopic eczema: a double-blind randomised controlled trial , 2012, Archives of Disease in Childhood.

[4]  Gordon H Guyatt,et al.  Credibility of claims of subgroup effects in randomised controlled trials: systematic review , 2012, BMJ : British Medical Journal.

[5]  R T O'Neill,et al.  The Prevention and Treatment of Missing Data in Clinical Trials: An FDA Perspective on the Importance of Dealing With It , 2012, Clinical pharmacology and therapeutics.

[6]  Andrew J Copas,et al.  Combining Multiple Imputation and Inverse-Probability Weighting , 2012, Biometrics.

[7]  Leonard Bickman,et al.  Person Mobility in the Design and Analysis of Cluster-Randomized Cohort Prevention Trials , 2012, Prevention Science.

[8]  C. McKevitt,et al.  Why do parents enrol their children in research: a narrative synthesis , 2011, Journal of Medical Ethics.

[9]  Susanne Stampf,et al.  Correction of confounding bias in non‐randomized studies by appropriate weighting , 2011, Biometrical journal. Biometrische Zeitschrift.

[10]  P. Williamson,et al.  Processes in recruitment to randomised controlled trials of medicines for children (RECRUIT): a qualitative study. , 2011, Health technology assessment.

[11]  Ian R White,et al.  Strategy for intention to treat analysis in randomised trials with missing outcome data , 2011, BMJ : British Medical Journal.

[12]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[13]  Mary J. Renfrew,et al.  Infant Feeding Survey 2010 , 2011 .

[14]  E. Simpson,et al.  Eczema prevalence in the United States: data from the 2003 National Survey of Children's Health. , 2011, The Journal of investigative dermatology.

[15]  Jonathan C. Craig,et al.  Strategies for Increasing Recruitment to Randomised Controlled Trials: Systematic Review , 2010, PLoS medicine.

[16]  S. Cole,et al.  Generalizing evidence from randomized clinical trials to target populations: The ACTG 320 trial. , 2010, American journal of epidemiology.

[17]  David Moher,et al.  AHRQ series paper 4: assessing harms when comparing medical interventions: AHRQ and the effective health-care program. , 2010, Journal of clinical epidemiology.

[18]  R. Spijker,et al.  Is there a rural/urban gradient in the prevalence of eczema? A systematic review , 2010, The British journal of dermatology.

[19]  Duolao Wang,et al.  Dietary supplementation with lactobacilli and bifidobacteria is well tolerated and not associated with adverse events during late pregnancy and early infancy. , 2010, The Journal of nutrition.

[20]  J P Vandenbroucke,et al.  How to assess the external validity of therapeutic trials: a conceptual approach. , 2010, International journal of epidemiology.

[21]  Patrick J O'Connor,et al.  Population reach and recruitment bias in a maintenance RCT in physically active older adults. , 2010, Journal of physical activity & health.

[22]  R. Lyons,et al.  The SAIL Databank: building a national architecture for e-health research and evaluation , 2009, BMC health services research.

[23]  S. Petrou,et al.  The relationship between household income and childhood respiratory health in the United Kingdom. , 2009, Social science & medicine.

[24]  N. Powe,et al.  External Validity of the Cardiovascular Health Study: A Comparison With the Medicare Population , 2009, Medical care.

[25]  Sara T Brookes,et al.  A review of reporting of participant recruitment and retention in RCTs in six major journals , 2009, Trials.

[26]  F. Hamdy,et al.  It's not just what you say, it's also how you say it: opening the 'black box' of informed consent appointments in randomised controlled trials. , 2009, Social science & medicine.

[27]  C. Frangakis The calibration of treatment effects from clinical trials to target populations , 2009, Clinical trials.

[28]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: Developing a prognostic model , 2009, BMJ : British Medical Journal.

[29]  Melissa C Brouwers,et al.  Written informed consent and selection bias in observational studies using medical records: systematic review , 2009, BMJ : British Medical Journal.

[30]  B. Young,et al.  How do parents experience being asked to enter a child in a randomised controlled trial? , 2009, BMC medical ethics.

[31]  I. Borowsky,et al.  From adolescent connections to social capital: predictors of civic engagement in young adulthood. , 2009, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[32]  Kerina H. Jones,et al.  The SAIL databank: linking multiple health and social care datasets , 2009, BMC Medical Informatics Decis. Mak..

[33]  D. Altman,et al.  Assessing Risk of Bias in Included Studies , 2008 .

[34]  Sampling 'hard-to-reach' populations in health research: yield from a study targeting Americans living in Canada , 2008, BMC medical research methodology.

[35]  P. Middleton,et al.  A thematic analysis of factors influencing recruitment to maternal and perinatal trials , 2008 .

[36]  M. Hadders‐Algra,et al.  How much loss to follow-up is acceptable in long-term randomised trials and prospective studies? , 2008, Archives of Disease in Childhood.

[37]  S. Jordan,et al.  Evidence-based practice: the debate. , 2008, Journal of nursing management.

[38]  R. Redberg,et al.  Variations between clinical trial participants and Medicare beneficiaries in evidence used for Medicare national coverage decisions. , 2008, Archives of internal medicine.

[39]  M. Byrne,et al.  Predicting donation among an Irish sample of donors and nondonors: extending the theory of planned behavior , 2007, Transfusion.

[40]  D. Elbourne,et al.  Marketing and clinical trials: a case study , 2007, Trials.

[41]  C. Propper,et al.  Child health: evidence on the roles of family income and maternal mental health from a UK birth cohort. , 2007, Health economics.

[42]  D Elbourne,et al.  Recruitment to randomised trials: strategies for trial enrollment and participation study. The STEPS study. , 2007, Health technology assessment.

[43]  P. Chisnall Mail and Internet Surveys: The Tailored Design Method , 2007, Journal of Advertising Research.

[44]  Cary P. Gross,et al.  Recruiting Vulnerable Populations into Research: A Systematic Review of Recruitment Interventions , 2007, Journal of General Internal Medicine.

[45]  N. Rigotti,et al.  Recruiting pregnant smokers into a clinical trial: using a network-model managed care organization versus community-based practices. , 2007, Preventive medicine.

[46]  D. Mant,et al.  The Role Familiarity With Science and Medicine Plays in Parents’ Decision Making About Enrolling a Child in Vaccine Research , 2007, Qualitative health research.

[47]  I Roberts,et al.  Strategies to improve recruitment to research studies. , 2002, The Cochrane database of systematic reviews.

[48]  Peter Shepherd,et al.  Cohort profile: 1970 British Birth Cohort (BCS70). , 2006, International journal of epidemiology.

[49]  David J Torgerson,et al.  Increasing recruitment to randomised trials: a review of randomised controlled trials , 2006, BMC medical research methodology.

[50]  D. Elbourne,et al.  "It was a snap decision": parental and professional perspectives on the speed of decisions about participation in perinatal randomised controlled trials. , 2006, Social science & medicine.

[51]  S. Lagakos The challenge of subgroup analyses--reporting without distorting. , 2006, The New England journal of medicine.

[52]  Claire Snowdon,et al.  Does it matter if clinicians recruiting for a trial don't understand what the trial is really about? Qualitative study of surgeons' experiences of participation in a pragmatic multi-centre RCT , 2007, Trials.

[53]  C. Jackson,et al.  Participating in a trial in a critical situation: a qualitative study in pregnancy , 2006, Quality and Safety in Health Care.

[54]  D. Strachan,et al.  The predictive value of early life total immunoglobulin E measurement in identifying atopic children in a population‐based birth cohort study , 2006, Pediatric allergy and immunology : official publication of the European Society of Pediatric Allergy and Immunology.

[55]  C. Power,et al.  Cohort profile: 1958 British birth cohort (National Child Development Study). , 2006, International journal of epidemiology.

[56]  R. Groves Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[57]  G Godin,et al.  Factors explaining the intention to give blood among the general population , 2005, Vox sanguinis.

[58]  M Egger,et al.  The causes and effects of socio-demographic exclusions from clinical trials. , 2005, Health technology assessment.

[59]  J. Rychik,et al.  What factors are important to parents making decisions about neonatal research? , 2005, Archives of Disease in Childhood - Fetal and Neonatal Edition.

[60]  S. Edwards,et al.  Lay public's understanding of equipoise and randomisation in randomised controlled trials. , 2005, Health technology assessment.

[61]  United Kingdom. Infant Feeding Survey , 2005 .

[62]  D. Zarin,et al.  Challenges to evidence-based medicine: , 2005 .

[63]  D. Zarin,et al.  Challenges to evidence-based medicine: a comparison of patients and treatments in randomized controlled trials with patients and treatments in a practice research network. , 2005, Social psychiatry and psychiatric epidemiology.

[64]  B. Howard,et al.  Special populations recruitment for the Women's Health Initiative: successes and limitations. , 2004, Controlled clinical trials.

[65]  K. Hagen,et al.  Telephone reminders are effective in recruiting nonresponding patients to randomized controlled trials. , 2004, Journal of clinical epidemiology.

[66]  Heather Joshi,et al.  Millennium Cohort Study First Survey: A User’s Guide to Initial Findings , 2004 .

[67]  J. Hassi,et al.  Does non-responder bias have a significant effect on the results in a postal questionnaire study? , 2004, European Journal of Epidemiology.

[68]  G. Shapiro,et al.  Factors influencing parental consent in pediatric clinical research. , 2003, Pediatrics.

[69]  G. Marks,et al.  Are you busy for the next 5 years? Recruitment in the Childhood Asthma Prevention Study (CAPS) , 2002, Respirology.

[70]  L. G. Olson Patient-centred equipoise and the ethics of randomised controlled trials , 2002, Monash bioethics review.

[71]  H. Wichmann,et al.  Maternal compliance with nutritional recommendations in an allergy preventive programme , 2002, Archives of disease in childhood.

[72]  Ons,et al.  The National Statistics Socio-economic Classification User Manual , 2002 .

[73]  Marc Taylor,et al.  Research governance framework for health and social care. , 2002, Health & social care in the community.

[74]  Douglas G Altman,et al.  Systematic reviews in health care: Assessing the quality of controlled clinical trials. , 2001, BMJ.

[75]  S. Leucht,et al.  Dropout rates in randomised antipsychotic drug trials , 2001, Psychopharmacology.

[76]  S. Salminen,et al.  Probiotics in primary prevention of atopic disease: a randomised placebo-controlled trial , 2001, The Lancet.

[77]  R. Prinz,et al.  Recruitment and retention of participants in prevention trials involving family-based interventions. , 2001, American journal of preventive medicine.

[78]  E McColl,et al.  Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. , 2001, Health technology assessment.

[79]  E. Singer,et al.  Leverage-saliency theory of survey participation: description and an illustration. , 2000, Public opinion quarterly.

[80]  R M Groves,et al.  Consequences of reducing nonresponse in a national telephone survey. , 2000, Public opinion quarterly.

[81]  D. Strachan,et al.  Is there a geographical variation in eczema prevalence in the U.K.? Evidence from the 1958 British birth cohort study , 2000, The British journal of dermatology.

[82]  C Bain,et al.  Threats to Applicability of Randomised Trials: Exclusions and Selective Participation , 1999, Journal of health services research & policy.

[83]  R. Prescott,et al.  Factors that limit the quality, number and progress of randomised controlled trials. , 1999, Health technology assessment.

[84]  J. Krosnick,et al.  Survey research. , 1999, Annual review of psychology.

[85]  T. E. Prewitt,et al.  Quantitative assessment of recruitment efforts for prevention trials in two diverse black populations. , 1998, Preventive medicine.

[86]  D. Strachan,et al.  Prevalence of asthma symptoms, diagnosis, and treatment in 12–14 year old children across Great Britain (international study of asthma and allergies in childhood, ISAAC UK) , 1998, BMJ.

[87]  D. Cook,et al.  Using data from the 1991 census , 1995, BMJ.

[88]  Y. Thong,et al.  Sociodemographic and motivational characteristics of parents who volunteer their children for clinical research: a controlled study. , 1990, BMJ.

[89]  D. Black HEALTH AND DEPRIVATION: Inequality and the north , 1988 .

[90]  O. P. Gray,et al.  Child growth (0-5 years), and the effect of entitlement to a milk supplement. , 1981, Archives of disease in childhood.

[91]  D. Sackett Bias in analytic research. , 1979, Journal of chronic diseases.

[92]  E. Buskirk,et al.  A method for assessing volunteer bias and its application to a cardiovascular disease prevention progamme involving physical activity. , 1978, Journal of epidemiology and community health.

[93]  A D Browne,et al.  Infant feeding survey. , 1966, Journal of the Irish Medical Association.