Benefits of extensive recruitment effort persist during follow-ups and are consistent across age group and survey method. The TRAILS study

BackgroundExtensive recruitment effort at baseline increases representativeness of study populations by decreasing non-response and associated bias. First, it is not known to what extent increased attrition occurs during subsequent measurement waves among subjects who were hard-to-recruit at baseline and what characteristics the hard-to-recruit dropouts have compared to the hard-to-recruit retainers. Second, it is unknown whether characteristics of hard-to-recruit responders in a prospective population based cohort study are similar across age group and survey method.MethodsFirst, we compared first wave (T1) easy-to-recruit with hard-to-recruit responders of the TRacking Adolescents’ Individual Lives Survey (TRAILS), a prospective population based cohort study of Dutch (pre)adolescents (at first wave: n = 2230, mean age = 11.09 (SD 0.56), 50.8% girls), with regard to response rates at subsequent measurement waves. Second, easy-to-recruit and hard-to-recruit participants at the fourth TRAILS measurement wave (n = 1881, mean age = 19.1 (SD 0.60), 52.3% girls) were compared with fourth wave non-responders and earlier stage drop-outs on family composition, socioeconomic position (SEP), intelligence (IQ), education, sociometric status, substance use, and psychopathology.ResultsFirst, over 60% of the hard-to-recruit responders at the first wave were retained in the sample eight years later at the fourth measurement wave. Hard-to-recruit dropouts did not differ from hard-to-recruit retainers. Second, extensive recruitment efforts for the web based survey convinced a population of nineteen year olds with similar characteristics as the hard-to-recruit eleven year olds that were persuaded to participate in a school-based survey. Some characteristics associated with being hard-to-recruit (as compared to being easy-to-recruit) were more pronounced among non-responders, resembling the baseline situation (De Winter et al.2005).ConclusionsFirst, extensive recruitment effort at the first assessment wave of a prospective population based cohort study has long lasting positive effects. Second, characteristics of hard-to-recruit responders are largely consistent across age groups and survey methods.

[1]  S. Gates,et al.  Maximising response to postal questionnaires – A systematic review of randomised trials in health research , 2006, BMC medical research methodology.

[2]  H. Aro,et al.  The problem of attrition in a Finnish longitudinal survey on depression , 2004, European Journal of Epidemiology.

[3]  J. Coie,et al.  Preadolescent peer status, aggression, and school adjustment as predictors of externalizing problems in adolescence. , 1990, Child development.

[4]  René Veenstra,et al.  Evaluation of non-response bias in mental health determinants and outcomes in a large sample of pre-adolescents , 2005, European Journal of Epidemiology.

[5]  Anne Johanne Søgaard,et al.  Response rates and selection problems, with emphasis on mental health variables and DNA sampling, in large population-based, cross-sectional and longitudinal studies of adolescents in Norway , 2010, BMC public health.

[6]  E. Costello,et al.  Cumulative prevalence of psychiatric disorders by young adulthood: a prospective cohort analysis from the Great Smoky Mountains Study. , 2011, Journal of the American Academy of Child and Adolescent Psychiatry.

[7]  W. Bukowski,et al.  Potential bias in classroom research: comparison of children with permission and those who do not receive permission to participate. , 1997, Journal of clinical child psychology.

[8]  A. Caspi,et al.  How common are common mental disorders? Evidence that lifetime prevalence rates are doubled by prospective versus retrospective ascertainment , 2009, Psychological Medicine.

[9]  Lynn S. Fuchs,et al.  Rates of Classroom Participation and the Validity of Sociometry , 2000 .

[10]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2007, Preventive medicine.

[11]  Douglas G Altman,et al.  [The Strengthening the Reporting of Observational Studies in Epidemiology [STROBE] statement: guidelines for reporting observational studies]. , 2007, Gaceta sanitaria.

[12]  René Veenstra,et al.  Same-gender and cross-gender peer acceptance and peer rejection and their relation to bullying and helping among preadolescents: comparing predictions from gender-homophily and goal-framing approaches. , 2007, Developmental psychology.

[13]  K. Lamberts,et al.  Selective drop-out in longitudinal studies and non-biased prediction of behaviour disorders , 2009, The British journal of psychiatry : the journal of mental science.

[14]  J. Rosmalen,et al.  Being Admired or Being Liked: Classroom Social Status and Depressive Problems in Early Adolescent Girls and Boys , 2007, Journal of abnormal child psychology.

[15]  R. Kaltiala-Heino,et al.  Does problem behaviour affect attrition from a cohort study on adolescent mental health? , 2011, European journal of public health.

[16]  R M Groves,et al.  Advances in strategies for minimizing and adjusting for survey nonresponse. , 1995, Epidemiologic reviews.

[17]  Alana D. Steffen,et al.  The Effect of Multiple Mailings on Recruitment: The Multiethnic Cohort , 2008, Cancer Epidemiology Biomarkers & Prevention.

[18]  K. Bucholz,et al.  Is a history of alcohol problems or of psychiatric disorder associated with attrition at 11-year follow-up? , 1996, Annals of epidemiology.

[19]  F. Smit,et al.  Psychiatric and sociodemographic predictors of attrition in a longitudinal study: The Netherlands Mental Health Survey and Incidence Study (NEMESIS). , 2000, American journal of epidemiology.

[20]  Olga V. Demler,et al.  Clinical calibration of DSM‐IV diagnoses in the World Mental Health (WMH) version of the World Health Organization (WHO) Composite International Diagnostic Interview (WMH‐CIDI) , 2004, International journal of methods in psychiatric research.

[21]  W. Eaton,et al.  Psychopathology and attrition in the Baltimore ECA 15-year follow-up 1981–1996 , 1999, Social Psychiatry and Psychiatric Epidemiology.

[22]  C. Davis,et al.  Participation in pediatric epidemiologic research: the SEARCH for Diabetes in Youth Study experience. , 2008, Contemporary clinical trials.

[23]  T. Achenbach Manual for the Youth Self-Report and 1991 profile , 1991 .

[24]  F. Zitman,et al.  Sociodemographic and psychiatric determinants of attrition in the Netherlands Study of Depression and Anxiety (NESDA). , 2012, Comprehensive psychiatry.

[25]  T. Achenbach Manual for the child behavior checklist/4-18 and 1991 profile , 1991 .

[26]  A Rogier T Donders,et al.  Unpredictable bias when using the missing indicator method or complete case analysis for missing confounder values: an empirical example. , 2010, Journal of clinical epidemiology.

[27]  M. Althaus,et al.  Information processing profiles of internalizing and externalizing behavior problems: evidence from a population-based sample of preadolescents. , 2007, Journal of child psychology and psychiatry, and allied disciplines.

[28]  L. Ezpeleta,et al.  Features associated with the non-participation and drop out by socially-at-risk children and adolescents in mental-health epidemiological studies , 2007, Social Psychiatry and Psychiatric Epidemiology.

[29]  Fausto Mazzi,et al.  Concordance of the Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health Surveys , 2006, International journal of methods in psychiatric research.

[30]  K. Kendler,et al.  Stressful life events and major depression: risk period, long-term contextual threat, and diagnostic specificity. , 1998, The Journal of nervous and mental disease.

[31]  An evaluation of nonresponse bias in peer, self, and teacher ratings of children's psychosocial adjustment. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[32]  Harry B. G. Ganzeboom,et al.  Internationally Comparable Measures of Occupational Status for the 1988 International Standard Classification of Occupations , 1996 .

[33]  F. Verhulst,et al.  Mental health in immigrant children in the Netherlands , 2005, Social Psychiatry and Psychiatric Epidemiology.

[34]  René Veenstra,et al.  Beyond the Class Norm: Bullying Behavior of Popular Adolescents and its Relation to Peer Acceptance and Rejection , 2008, Journal of abnormal child psychology.

[35]  M. Hotopf,et al.  How many mailouts? Could attempts to increase the response rate in the Iraq war cohort study be counterproductive? , 2007, BMC medical research methodology.

[36]  B. Penninx,et al.  Screening for depression and anxiety: correlates of non‐response and cohort attrition in the Netherlands Study of Depression and Anxiety (NESDA) , 2009, International journal of methods in psychiatric research.

[37]  J. Kaprio,et al.  The role of temperament in the relationship between early onset of tobacco and cannabis use: the TRAILS study. , 2009, Drug and alcohol dependence.

[38]  M. H. Rod,et al.  The Danish Youth Cohort: Characteristics of participants and non-participants and determinants of attrition , 2010, Scandinavian journal of public health.

[39]  C. Perry,et al.  The measurement of substance use among adolescents: when is the 'bogus pipeline' method needed? , 1987, Addictive behaviors.

[40]  T. B. Üstün,et al.  The World Health Organization composite international diagnostic interview. , 2008 .

[41]  Everett E. Davis,et al.  WISC-R, Wechsler Intelligence Scale for Children—Revised , 1975 .

[42]  J. Unger,et al.  Characteristics of adolescents who provide neither parental consent nor refusal for participation in school-based survey research. , 2004, Evaluation review.

[43]  D O Stram,et al.  A multiethnic cohort in Hawaii and Los Angeles: baseline characteristics. , 2000, American journal of epidemiology.

[44]  M. Partin,et al.  Mixed-mode administration reduced bias and enhanced poststratification adjustments in a health behavior survey. , 2007, Journal of clinical epidemiology.

[45]  Frank C Verhulst,et al.  Cohort profile: the Dutch 'TRacking Adolescents' Individual Lives' Survey'; TRAILS. , 2008, International journal of epidemiology.