An Exploratory Study about Inaccuracy and Invalidity in Adolescent Self-Report Surveys

Using Add Health data, the authors provide evidence that some adolescents gave inaccurate and/or invalid responses on a self-administered questionnaire. Further analyses show that these adolescents were much more likely to report extreme levels on psychosocial and behavioral outcome variables. A distinction was made between inaccurate responders (e.g., inaccurate/false responses due to carelessness or confusion) and jokesters (e.g., intentional false responses). The findings show that the jokesters showed considerably more pronounced distorting effects on some psychosocial and behavioral outcome variables than the inaccurate responders did. The authors suggest that although this jokester effect may not seriously bias the results in studies that focus on large groups, for research focusing on some special subgroups (e.g., adoption groups, immigrant groups, disability groups), this effect could pose a serious challenge for the validity of research findings.

[1]  Xitao Fan,et al.  Antisocial Behavior of Adoptees and Nonadoptees: Prediction from Early History and Adolescent Relationships , 2006 .

[2]  R. Williams,et al.  Validity of Adolescent Self-Report of Substance Use , 2005, Substance use & misuse.

[3]  R. Detels,et al.  An Approach to Improve Validity of Responses in a Sexual Behavior Study in a Rural Area of China , 1999, AIDS and Behavior.

[4]  Xitao Fan,et al.  Questionnaire and Interview Inconsistencies Exaggerated Differences Between Adopted and Non-Adopted Adolescents in a National Sample , 2002 .

[5]  R. Flewelling,et al.  African American Male Adolescents' Involvement in the Criminal Justice System: The Criterion Validity of Self-Report Measures in a Prospective Study , 2001 .

[6]  Robert H. Tai,et al.  The help-seeking orientations of Latino and non-Latino urban high school students: a critical-sociological investigation , 2001 .

[7]  R. Blum,et al.  Development of adolescent self-report measures from the National Longitudinal Study of Adolescent Health. , 2001, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[8]  B. Miller,et al.  Adopted adolescents' overrepresentation in mental health counseling: adoptees' problems or parents' lower threshold for referral? , 2000, Journal of the American Academy of Child and Adolescent Psychiatry.

[9]  B. Miller,et al.  Comparisons of adopted and nonadopted adolescents in a large, nationally representative sample. , 2000, Child development.

[10]  E. Goodman,et al.  Accuracy of Teen and Parental Reports of Obesity and Body Mass Index , 2000, Pediatrics.

[11]  Christopher B. Forrest,et al.  The Validity of Measures of Socioeconomic Status of Adolescents , 2000 .

[12]  E. Wish,et al.  Correlates of Underreporting of Post-Discharge Cocaine Use among Therapeutic Community Clients , 2000 .

[13]  W. Aquilino,et al.  Collecting Sensitive Self-Report Data With Laptop Computers: Impact on the Response Tendencies of Adolescents in a Home Interview , 1999 .

[14]  A. Stone,et al.  The science of self-report. Implications for research and practice , 1999 .

[15]  Blaine R. Worthen Measurement and Assessment in the Schools , 1998 .

[16]  S. M. Rogers,et al.  Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. , 1998, Science.

[17]  S. Urbina,et al.  Psychological testing, 7th ed. , 1997 .

[18]  Janet L. Lauritsen,et al.  The consistency of self-reported initiation of sexual activity. , 1997, Family planning perspectives.

[19]  C. Gordy,et al.  AFTER-CLASS VERSUS IN-CLASS DATA COLLECTION : VALIDITY ISSUES , 1996 .

[20]  Tom W. Smith,et al.  ASKING SENSITIVE QUESTIONS THE IMPACT OF DATA COLLECTION MODE, QUESTION FORMAT, AND QUESTION CONTEXT , 1996 .

[21]  Lauritsen Jl,et al.  The Consistency of Self-Reported Initiation of Sexual Activity , 1997 .

[22]  Y. Hser Data Sources: Problems and Issues , 1993 .

[23]  J. Udry,et al.  Adolescents' Honesty in a Survey of Sexual Behavior , 1988 .

[24]  Michael Hennessy,et al.  An Evaluation of the Validity and Reliability of Survey Response Data On Household Electricity Conservation , 1985 .

[25]  P. Killworth,et al.  The Problem of Informant Accuracy: The Validity of Retrospective Data , 1984 .

[26]  R. Akers,et al.  Are self-reports of adolescent deviance valid? Biochemical measures, randomized response, and the bogus pipeline in smoking behavior. , 1983 .

[27]  J. Conley Asking questions: A practical guide to questionnaire design , 1983 .

[28]  R. Berk An Evaluation of the Validity and Reliability of Adaptive Behavior Scales. , 1981 .

[29]  Seymour Sudman,et al.  Response Effects in Surveys: A Review and Synthesis , 1974 .

[30]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[31]  N. Tallent Psychological testing. , 1960, The American journal of nursing.