Truth or consequences: the intertemporal consistency of adolescent self-report on the Youth Risk Behavior Survey.

Surveys are the primary information source about adolescents' health risk behaviors, but adolescents may not report their behaviors accurately. Survey data are used for formulating adolescent health policy, and inaccurate data can cause mistakes in policy creation and evaluation. The author used test-retest data from the Youth Risk Behavior Survey (United States, 2000) to compare adolescents' responses to 72 questions about their risk behaviors at a 2-week interval. Each question was evaluated for prevalence change and 3 measures of unreliability: inconsistency (retraction and apparent initiation), agreement measured as tetrachoric correlation, and estimated error due to inconsistency assessed with a Bayesian method. Results showed that adolescents report their sex, drug, alcohol, and tobacco histories more consistently than other risk behaviors in a 2-week period, opposite their tendency over longer intervals. Compared with other Youth Risk Behavior Survey topics, most sex, drug, alcohol, and tobacco items had stable prevalence estimates, higher average agreement, and lower estimated measurement error. Adolescents reported their weight control behaviors more unreliably than other behaviors, particularly problematic because of the increased investment in adolescent obesity research and reliance on annual surveys for surveillance and policy evaluation. Most weight control items had unstable prevalence estimates, lower average agreement, and greater estimated measurement error than other topics.

[1]  L. Joseph,et al.  Bayesian Approaches to Modeling the Conditional Dependence Between Multiple Diagnostic Tests , 2001, Biometrics.

[2]  L. Kann,et al.  Reliability of the Youth Risk Behavior Survey Questionnaire. , 1995, American journal of epidemiology.

[3]  G. Koch,et al.  Validity of self-reports and descriptive and analytical conclusions: the case of cigarette smoking by adolescents and their mothers. , 1983, American journal of epidemiology.

[4]  L. Midanik.  Perspectives on the validity of self-reported alcohol use. , 1989, British journal of addiction.

[5]  Floyd J. Fowler,et al.  Survey Research Methods , 1984 .

[6]  M. Banerjee,et al.  Beyond kappa: A review of interrater agreement measures , 1999 .

[7]  J. Rosenbaum.  Reborn a virgin: adolescents' retracting of virginity pledges and sexual histories. , 2006, American journal of public health.

[8]  W. Pedersen.  Reliability of drug use responses in a longitudinal study. , 1990, Scandinavian journal of psychology.

[9]  L. Kann,et al.  Youth risk behavior surveillance--United States, 1999. , 2000, MMWR. CDC surveillance summaries : Morbidity and mortality weekly report. CDC surveillance summaries.

[10]  Roger Tourangeau,et al.  Remembering What Happened: Memory Errors and Survey Reports , 1999 .

[11]  M. Somerfield,et al.  Consistency of adolescents' self-report of sexual behavior in a longitudinal study , 1993 .

[12]  G. Koch,et al.  On the measurement of tobacco use by adolescents. Validity of self-reports of smokeless tobacco use and validity of cotinine as an indicator of cigarette smoking. , 1989, American journal of epidemiology.

[13]  D. Kandel,et al.  UNDERREPORTING OF SUBSTANCE USE IN A NATIONAL LONGITUDINAL YOUTH COHORT INDIVIDUAL AND INTERVIEWER EFFECTS , 1988 .

[14]  L. Kann,et al.  The Youth Risk Behavior Surveillance System: policy and program applications. , 1997, The Journal of school health.

[15]  References , 1971 .

[16]  Paul R. Abramson,et al.  Who Overreports Voting? , 1986, American Political Science Review.

[17]  L. Kann,et al.  Assessing health risk behaviors among adolescents: the effect of question wording and appeals for honesty. , 2004, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[18]  Laura Kann,et al.  The Youth Risk Behavior Surveillance System: updating policy and program applications. , 2002, The Journal of school health.

[19]  J. Billy,et al.  Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: evidence from the scientific literature. , 2003, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[20]  W. Stanton,et al.  Prevalence, reliability and bias of adolescents' reports of smoking and quitting. , 1996, Addiction.

[21]  D. Kirk.  Examining the Divergence Across Self-report and Official Data Sources on Inferences About the Adolescent Life-course of Crime , 2006 .

[22]  J. Darroch,et al.  Measuring the extent of abortion underreporting in the 1995 National Survey of Family Growth. , 1998, Family planning perspectives.

[23]  Karl Pearson,et al.  Mathematical contributions to the theory of evolution. VIII. On the correlation of characters not quantitatively measurable , 1900, Proceedings of the Royal Society of London.

[24]  M. Fendrich,et al.  Multiwave analysis of retest artifact in the National Longitudinal Survey of Youth drug use. , 2001, Drug and alcohol dependence.

[25]  L. Lillard,et al.  Inconsistencies in reporting the occurrence and timing of first intercourse among adolescents , 2002, Journal of sex research.

[26]  Laura Kann,et al.  Reliability of the 1999 youth risk behavior survey questionnaire. , 2002, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[27]  Diane C. Thompson,et al.  The validity of self-reported smoking: a review and meta-analysis. , 1994, American journal of public health.

[28]  D. Galuska,et al.  Reliability and validity of self-reported height and weight among high school students. , 2003, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[29]  J. Graham,et al.  Agreement Between Retrospective Accounts of Substance Use and Earlier Reported Substance Use , 1985 .

[30]  S. French,et al.  Agreement between survey and interview measures of weight control practices in adolescents. , 1998, The International journal of eating disorders.

[31]  R. Montjoy,et al.  Overreporting voting: why it happens and why it matters. , 2001, Public opinion quarterly.

[32]  A. Stone,et al.  The science of self-report. Implications for research and practice , 1999 .

[33]  Michael Fendrich,et al.  DIMINISHED LIFETIME SUBSTANCE USE OVER TIME: AN INQUIRY INTO DIFFERENTIAL UNDERREPORTING , 1994 .

[34]  B. Craig,et al.  Estimating disease prevalence in the absence of a gold standard , 2002, Statistics in medicine.

[35]  Floyd J. Fowler,et al.  Improving Survey Questions: Design and Evaluation , 1995 .

[36]  Wai-Yin Poon,et al.  Maximum likelihood estimation of polyserial correlations , 1986 .

[37]  P. Abramson,et al.  The Presence of Others and Overreporting of Voting in American National Elections , 1986 .

[38]  S. Presser.  Is Inaccuracy on Factual Survey Items Item-Specific or Respondent-Specific? , 1984 .

[39]  W. Grove,et al.  A latent trait finite mixture model for the analysis of rating agreement. , 1993, Biometrics.

[40]  M. Fendrich,et al.  Decreased drug reporting in a cross-sectional student drug use survey. , 2000, Journal of substance abuse.

[41]  W. Risser,et al.  Self-assessment of circumcision status by adolescents. , 2004, American journal of epidemiology.

[42]  C. Poulin,et al.  The validity of a province-wide student drug use survey: lessons in design. , 1993, Canadian journal of public health = Revue canadienne de sante publique.

[43]  Robert H. Hardt,et al.  On Determining the Quality of the Delinquency Self-Report Method , 1977 .

[44]  J. Tanur.  Questions About Questions , 1992 .

[45]  Peter Brimblecombe,et al.  Monitoring the future , 2010 .

[46]  I. Guggenmoos‐Holzmann,et al.  Kappa-like indices of observer agreement viewed from a latent class perspective. , 1998, Statistics in medicine.

[47]  R. Flewelling,et al.  The characterization of inconsistencies in self-reports of alcohol and marijuana use in a longitudinal study of adolescents. , 1992, Journal of studies on alcohol.

[48]  K. Winters,et al.  Validity of adolescent self-report of alcohol and other drug involvement. , 1990, The International journal of the addictions.

[49]  H. Toutenburg,et al.  A review of agreement measure as a subset of association measure between raters , 2004 .

[50]  Robyn M. Dawes,et al.  Personal Recall and the Limits of Retrospective Questions in Surveys , 1992 .

[51]  Wendy Baldwin,et al.  Information No One Else Knows: The Value of Self-Report , 1999 .

[52]  N. Bradburn,et al.  An Investigation of Interview Method, Threat and Response Distortion , 1976 .

[53]  J L Collins,et al.  Youth Risk Behavior Surveillance--United States, 1997. State and Local YRBSS Coordinators. , 1998, The Journal of school health.

[54]  R. Engels,et al.  Inconsistencies in adolescents' self-reports of initiation of alcohol and tobacco use. , 1997, Addictive behaviors.

[55]  Dennis P. Rosenbaum,et al.  Recanting of substance use reports in a longitudinal prevention study. , 2003, Drug and alcohol dependence.

[56]  J. Clapp,et al.  Self-report stability of adolescent substance use: are there differences for gender, ethnicity and age? , 2000, Drug and alcohol dependence.

[57]  L. Joseph,et al.  Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. , 1995, American journal of epidemiology.

[58]  Manfred Kuechler,et al.  Surveying Subjective Phenomena. , 1985 .