Using surveys to study substance use behavior

Population-based estimates of substance use patterns have been regularly reported for several decades. Concerns with the quality of the survey methodologies employed to produce these estimates, however, date back almost as far. These concerns have led to a considerable body of research specifically focused on understanding the nature and consequences of survey-based errors in substance use epidemiology. This chapter reviews and summarizes that empirical research by organizing it within a total survey error model framework that considers multiple types of representation and measurement errors. Gaps in knowledge regarding sources of error in substance use surveys and areas needing future research are also identified.

[1]  D. Hasin,et al.  Difficulties with questions on usual drinking and the measurement of alcohol consumption. , 1998, Alcoholism, clinical and experimental research.

[2]  Dike van de Mheen,et al.  Non-response bias in a sample survey on alcohol consumption. , 2002, Alcohol and alcoholism.

[3]  Seymour Sudman,et al.  Social Cognition and Responses to Survey Questions Among Culturally Diverse Populations , 1997 .

[4]  A. Hope,et al.  Alcohol survey measures for Europe: A literature review , 2013 .

[5]  E. Feskens,et al.  Non-response bias in a study of cardiovascular diseases, functional status and self-rated health among elderly men. , 1998, Age and ageing.

[6]  P. J. Marty,et al.  Effects of the bogus-pipeline on enhancing validity of self-reported adolescent drug use measures. , 1987, The Journal of school health.

[7]  L. Mewton,et al.  Improving the diagnostic criteria for alcohol use disorders through survey methodology and cognitive interviewing , 2014, International journal of methods in psychiatric research.

[8]  Linda Richter,et al.  Current Methods of Assessing Substance Use: A Review of Strengths, Problems, and Developments , 2001 .

[9]  S. Roesch,et al.  Typologies of recanting of lifetime cigarette, alcohol and marijuana use during a six-year longitudinal panel study. , 2011, Drug and alcohol dependence.

[10]  Gfroerer Jc,et al.  The feasibility of collecting drug abuse data by telephone. , 1991 .

[11]  M. Clatts,et al.  Club Drug Use Among Young Men Who Have Sex with Men in NYC: A Preliminary Epidemiological Profile , 2005, Substance use & misuse.

[12]  D. Kandel.  Reaching the hard-to-reach: illicit drug use among high school absentees. , 1975, Addictive diseases.

[13]  W. Darrow,et al.  Sex of interviewer, place of interview, and responses of homosexual men to sensitive questions , 1986, Archives of sexual behavior.

[14]  L. Kroutil,et al.  Estimated drug use based on direct questioning and open‐ended questions: responses in the 2006 National Survey on Drug Use and Health , 2010, International journal of methods in psychiatric research.

[15]  P. McCrystal,et al.  Response consistency in young adolescents' drug use self-reports: a recanting rate analysis. , 2005, Addiction.

[16]  W. Aquilino,et al.  Response Effects Due to Bystander Presence in CASI and Paper-and-Pencil Surveys of Drug Use and Alcohol Use , 2000, Substance use & misuse.

[17]  I. Meyer,et al.  Sampling Lesbian, Gay, and Bisexual Populations. , 2009 .

[18]  K. Poikolainen,et al.  Accuracy of retrospective measurement of individual alcohol consumption in men; a reinterview after 18 years. , 1983, Journal of studies on alcohol.

[19]  D. Luke,et al.  Public health surveillance of low-frequency populations. , 2004, Annual review of public health.

[20]  T. Johnson,et al.  Race/ethnicity differences in the validity of self-reported drug use: Results from a household survey , 2005, Journal of Urban Health.

[21]  Laura Kann,et al.  An assessment of the effect of data collection setting on the prevalence of health risk behaviors among adolescents. , 2002, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[22]  Jelke Bethlehem,et al.  Nonresponse in household surveys. , 2006 .

[23]  B. Grant,et al.  Age of onset of drug use and its association with DSM-IV drug abuse and dependence: results from the National Longitudinal Alcohol Epidemiologic Survey. , 1998, Journal of substance abuse.

[24]  W. Aquilino,et al.  EFFECTS OF INTERVIEW MODE ON SELF-REPORTED DRUG USE , 1990 .

[25]  Patrick M. O'Malley,et al.  When Four Months Equal a Year: Inconsistencies in Student Reports of Drug Use , 1981 .

[26]  H. Garretsen,et al.  The effect of data collection mode and ethnicity of interviewer on response rates and self-reported alcohol use among Turks and Moroccans in the Netherlands: an experimental study. , 2005, Alcohol and alcoholism.

[27]  G. S. Bowen,et al.  High Rates of Club Drug Use and Risky Sexual Practices Among Hispanic Men Who Have Sex with Men in Miami, Florida , 2005, Substance use & misuse.

[28]  T. Johnson,et al.  Detection and Prevention of Data Falsification in Survey Research , 2001 .

[29]  P. Miller.  Review: Is Up Right? The National Household Survey on Drug Abuse , 1997 .

[30]  J. Mundt,et al.  Validation of daily self-reported alcohol consumption using interactive voice response (IVR) technology. , 1995, Journal of studies on alcohol.

[31]  Jack Darkes,et al.  The validity of self-reports of alcohol consumption: state of the science and challenges for research. , 2003, Addiction.

[32]  Daniel F. McCaffrey,et al.  Recanting of life-time inhalant use: how big a problem and what to make of it. , 2009, Addiction.

[33]  M. R. De La Rosa,et al.  Current gaps and new directions for studying drug use and abuse behavior in minority youth. , 1993, NIDA research monograph.

[34]  L H Moore,et al.  Declarative and procedural memory functioning in abstinent cocaine abusers. , 1999, Archives of general psychiatry.

[35]  Roger Tourangeau,et al.  Remembering What Happened: Memory Errors and Survey Reports , 1999 .

[36]  Dennis P. Rosenbaum,et al.  Recanting of substance use reports in a longitudinal prevention study. , 2003, Drug and alcohol dependence.

[37]  Alcohol Drinking Onset: A Reliability Study , 2007 .

[38]  S. DeLauder.  Hair as a Bio‐Marker to Exposure ‐ Considering Issues of Racial Bias in Drug Testing , 2003 .

[39]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[40]  Tom W. Smith,et al.  ASKING SENSITIVE QUESTIONS THE IMPACT OF DATA COLLECTION MODE, QUESTION FORMAT, AND QUESTION CONTEXT , 1996 .

[41]  A. Stone,et al.  The science of self-report. Implications for research and practice , 1999 .

[42]  Linda M. Collins,et al.  Attrition in prevention research , 1985, Journal of Behavioral Medicine.

[43]  R. Engels,et al.  Inconsistencies in adolescents' self-reports of initiation of alcohol and tobacco use. , 1997, Addictive behaviors.

[44]  L. Midanik.  Comparing usual quantity/frequency and graduated frequency scales to assess yearly alcohol consumption: results from the 1990 US National Alcohol Survey. , 1994, Addiction.

[45]  L. Kann,et al.  Methodological Considerations in Estimating Adolescent Substance Use , 2012 .

[46]  D. Marlowe,et al.  The Approval Motive: Studies in Evaluative Dependence , 1980 .

[47]  D. McCaffrey,et al.  Inconsistencies in self-reported drug use by adolescents in substance abuse treatment: implications for outcome and performance measurements. , 2008, Journal of substance abuse treatment.

[48]  G. Cohen,et al.  Are nonrespondents to health surveys less healthy than respondents , 2002 .

[49]  H A MULFORD,et al.  Drinking in Iowa. I. Sociocultural distribution of drinkers; with a methodological model for sampling evaluation and interpretation of findings. , 1959, Quarterly journal of studies on alcohol.

[50]  Jennie Connor,et al.  Non-response bias in a web-based health behaviour survey of New Zealand tertiary students. , 2011, Preventive medicine.

[51]  M. J. Luetgert,et al.  Methodological issues in drug usage surveys: anonymity, recency, and frequency. , 1973, The International journal of the addictions.

[52]  D. Osgood,et al.  The generality of deviance in late adolescence and early adulthood. , 1988 .

[53]  A. Zanes,et al.  Different Settings, Different Results? A Comparison of School and Home Responses , 1979 .

[54]  T. Laatikainen,et al.  Marital status, educational level and household income explain part of the excess mortality of survey non-respondents , 2010, European Journal of Epidemiology.

[55]  F. Zitman,et al.  Sociodemographic and psychiatric determinants of attrition in the Netherlands Study of Depression and Anxiety (NESDA). , 2012, Comprehensive psychiatry.

[56]  P. Rautava,et al.  Non-response and related factors in a nation-wide health survey , 2004, European Journal of Epidemiology.

[57]  D. Paulhus.  Measurement and control of response bias. , 1991 .

[58]  R. de Graaf,et al.  Sociodemographic and psychiatric predictors of attrition in a prospective psychiatric epidemiological study among the general population. Result of the Netherlands Mental Health Survey and Incidence Study-2. , 2013, Comprehensive psychiatry.

[59]  Herman Aguinis,et al.  Enhancing the validity of self-reported alcohol and marijuana consumption using a bogus pipeline procedure: A meta-analytic review. , 1995 .

[60]  G. Gmel,et al.  Measuring Alcohol Consumption , 2004 .

[61]  K. Kypri,et al.  The Effect of Low Survey Response Rates on Estimates of Alcohol Consumption in a General Population Survey , 2012, PloS one.

[62]  D. McCaffrey,et al.  Measurement of Adolescent Drug Use , 2003, Journal of psychoactive drugs.

[63]  L. Midanik,et al.  Reports of alcohol-related harm: telephone versus face-to-face interviews. , 2001, Journal of studies on alcohol.

[64]  J. Rehm,et al.  Difficulties with telephone‐based surveys on alcohol consumption in high‐income countries: the Canadian example , 2012, International journal of methods in psychiatric research.

[65]  O. Ekholm.  Influence of the recall period on self-reported alcohol intake , 2004, European Journal of Clinical Nutrition.

[66]  K. Tambs,et al.  Alcohol use and mental distress as predictors of non-response in a general population health survey: the HUNT study , 2011, Social Psychiatry and Psychiatric Epidemiology.

[67]  L. Harrison.  Understanding the Differences in Youth Drug Prevalence Rates Produced by the MTF, NHSDA, and Yrbs Studies , 2001 .

[68]  T. Johnson,et al.  Validity of self-reported substance use in men who have sex with men: comparisons with a general population sample. , 2008, Annals of epidemiology.

[69]  T. Johnson,et al.  Monthly variations in self-reports of alcohol consumption. , 2001, Journal of studies on alcohol.

[70]  James Chromy,et al.  Impact of Interviewer Experience on Respondent Reports of Substance Use , 2002 .

[71]  A. Tjønneland,et al.  Mortality among participants and non-participants in a prospective cohort study , 2012, European Journal of Epidemiology.

[72]  Michael W. Arthur,et al.  Panel attrition and external validity in adolescent substance use research. , 1992, Journal of consulting and clinical psychology.

[73]  J. Gfroerer,et al.  Prevalence of youth substance use: the impact of methodological differences between two national surveys. , 1997, Drug and alcohol dependence.

[74]  T. Johnson,et al.  Cross-Cultural Sources of Measurement Error in Substance Use Surveys , 2003, Substance use & misuse.

[75]  V. Mays,et al.  AIDS survey methodology with black Americans. , 1991, Social science & medicine.

[76]  A. Ardila,et al.  Neuropsychological deficits in chronic cocaine abusers. , 1991, The International journal of neuroscience.

[77]  Timothy P. Johnson,et al.  An Evaluation of the Effects of Interviewer Characteristics in an RDD Telephone Survey of Drug Use , 2000 .

[78]  T. Johnson,et al.  The reliability of self-reported age of onset of tobacco, alcohol and illicit drug use. , 2001, Addiction.

[79]  I. Bongers,et al.  Mode effects on self-reported alcohol use and problem drinking: mail questionnaires and personal interviewing compared. , 1998, Journal of studies on alcohol.

[80]  D. Gunnell,et al.  Non-response bias in a lifestyle survey. , 1997, Journal of public health medicine.

[81]  K. Winters,et al.  Validity of adolescent self-report of alcohol and other drug involvement. , 1990, The International journal of the addictions.

[82]  C. DeBlaere,et al.  Conducting Research With LGB People of Color: Methodological Challenges and Strategies , 2010 .

[83]  L. Ouellet,et al.  “Crack” versus “rock” cocaine: the importance of local nomenclature in drug research and education , 1997 .

[84]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[85]  J. Ormel,et al.  Survey non-response in the Netherlands: effects on prevalence estimates and associations. , 2003, Annals of epidemiology.

[86]  J. Mckillip,et al.  Response bias in drug surveys. , 1973, Journal of consulting and clinical psychology.

[87]  J Rehm,et al.  Assessment methods for alcohol consumption, prevalence of high risk drinking and harm: a sensitivity analysis. , 1999, International journal of epidemiology.

[88]  R. Clayton,et al.  Gender-Related Differences in Psychoactive Drug Use among Older Adults , 1989 .

[89]  T. Johnson,et al.  An evaluation of the validity of the Crowne–Marlowe need for approval scale , 2012 .

[90]  Jason Ferris,et al.  Surveying alcohol and other drug use through telephone sampling: a comparison of landline and mobile phone samples , 2013, BMC Medical Research Methodology.

[91]  R. Steer,et al.  Estimating illicit drug use through telephone interviews and the randomized response technique. , 1986, Drug and alcohol dependence.

[92]  G. Gmel,et al.  Recall bias for seven-day recall measurement of alcohol consumption among emergency department patients: implications for case-crossover designs. , 2007, Journal of studies on alcohol and drugs.

[93]  L. Sobell,et al.  Factors affecting agreement between alcohol abusers' and their collaterals' reports. , 1997, Journal of studies on alcohol.

[94]  B. Quednow,et al.  Cognitive dysfunctions in recreational and dependent cocaine users: role of attention-deficit hyperactivity disorder, craving and early age at onset , 2013, British Journal of Psychiatry.

[95]  F. D. Del Boca,et al.  Talk is cheap: measuring drinking outcomes in clinical trials. , 2000, Journal of studies on alcohol.

[96]  E. Spitznagel,et al.  Difficult-to-recruit respondents and their effect on prevalence estimates in an epidemiologic survey. , 1987, American journal of epidemiology.

[97]  B. Grant,et al.  Nonresponse bias in survey estimates of alcohol consumption and its association with harm. , 2014, Journal of studies on alcohol and drugs.

[98]  J. Lorence,et al.  Reliability and validity of adolescent self-reported drug use in a family-based study: a methodological report. , 1983, The International journal of the addictions.

[99]  Presidential Address Applying a Total Error Perspective for Improving Research Quality in the Social, Behavioral, and Marketing Sciences , 2013 .

[100]  H. Sahai,et al.  The validity of drug use self-reports among hard core drug users in a household survey in Puerto Rico: comparison of survey responses of cocaine and heroin use with hair tests. , 2002, Drug and alcohol dependence.

[101]  R M Groves,et al.  Consequences of reducing nonresponse in a national telephone survey. , 2000, Public opinion quarterly.

[102]  N. Keiding,et al.  Effects of sample attrition in a longitudinal study of the association between alcohol intake and all-cause mortality. , 2008, Addiction.

[103]  L. Melton,et al.  Comparison of respondents and nonrespondents in an osteoporosis study. , 1994, Annals of epidemiology.

[104]  D. Dawson,et al.  Methodological Issues in Measuring Alcohol Use , 2003, Alcohol research & health : the journal of the National Institute on Alcohol Abuse and Alcoholism.

[105]  Michael S. Goodstadt,et al.  The Randomized Response Technique: A Test on Drug Use , 1975 .

[106]  Joel M. Moskowitz,et al.  Anonymous Versus Identifiable Self-Reports of Adolescent Drug Attitudes, Intentions, and Use , 1983 .

[107]  U. McCann,et al.  Memory impairment in abstinent MDMA ("Ecstasy") users , 1998, Neurology.

[108]  I. White,et al.  Test-retest reliability of an online measure of past week alcohol consumption (the TOT-AL), and comparison with face-to-face interview. , 2009, Addictive behaviors.

[109]  Amy L. Hubbell,et al.  The utility of drug testing in epidemiological research: results from a general population survey. , 2004, Addiction.

[110]  H. Alho,et al.  Accuracy of quantity-frequency and graduated frequency questionnaires in measuring alcohol intake: comparison with daily diary and commonly used laboratory markers. , 2002, Alcohol and alcoholism.

[111]  Danielle E. Ramo,et al.  Reliability and validity of young adults' anonymous online reports of marijuana use and thoughts about use. , 2012, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[112]  J. Lange,et al.  "My drink is larger than yours"? A literature review of self-defined drink sizes and standard drinks. , 2008, Current drug abuse reviews.

[113]  R. Janssen,et al.  HIV Prevalence and Associated Risks in Young Men Who Have Sex With Men , 2000 .

[114]  S. Stansfeld,et al.  Drinking histories of self-identified lifetime abstainers and occasional drinkers: findings from the 1958 British Birth Cohort Study. , 2006, Alcohol and alcoholism.

[115]  L. Schmidt,et al.  Assessing bias in community-based prevalence estimates: towards an unduplicated count of problem drinkers and drug users. , 1995, Addiction.

[116]  Dike van de Mheen,et al.  Estimating non-response bias in a survey on alcohol consumption: comparison of response waves. , 2003, Alcohol and alcoholism.

[117]  T. Heeren,et al.  Predictors of disclosure of continued cocaine use. , 2006, Addictive behaviors.

[118]  E. Ip,et al.  Attrition bias in a U.S. Internet survey of alcohol use among college freshmen. , 2009, Journal of studies on alcohol and drugs.

[119]  T. Chikritzhs,et al.  Under-reporting of alcohol consumption in household surveys: a comparison of quantity-frequency, graduated-frequency and recent recall. , 2004, Addiction.

[120]  Laura Kann,et al.  Comparison of Paper-and-Pencil Versus Web Administration of the Youth Risk Behavior Survey (YRBS): Risk Behavior Prevalence Estimates , 2010, Evaluation review.

[121]  L. Midanik,et al.  Effects of telephone versus face-to-face interview modes on reports of alcohol consumption. , 2000, Addiction.

[122]  Roland S. Moore,et al.  Survey confidentiality vs anonymity: Young men's self-reported substance use. , 2002 .

[123]  L. Sobell,et al.  Do quantity-frequency data underestimate drinking-related health risks? , 1982, American journal of public health.

[124]  R. Bauserman,et al.  HIV and AIDS surveillance among inmates in Maryland prisons , 2001, Journal of Urban Health.

[125]  J. Billy,et al.  Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: evidence from the scientific literature. , 2003, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[126]  M. Elliott,et al.  Sample designs for measuring the health of small racial/ethnic subgroups , 2008, Statistics in medicine.

[127]  M. Russell,et al.  Influence of socially desirable responding in a study of stress and substance abuse. , 1993, Alcoholism, clinical and experimental research.

[128]  A. R. Lang,et al.  Alcohol Use and Other Psychiatric Disorders in the Formerly Homeless and Never Homeless: Prevalence, Age of Onset, Comorbidity, Temporal Sequencing, and Service Utilization , 2003, Substance use & misuse.

[129]  R. Knibbe,et al.  Bias due to non-response in a Dutch survey on alcohol consumption. , 1988, British journal of addiction.

[130]  R. Windsor,et al.  Use of a bogus pipeline method to increase accuracy of self-reported alcohol consumption among pregnant women. , 1986, Journal of studies on alcohol.

[131]  Robert M. Groves,et al.  Survey Errors and Survey Costs: Groves/Survey Errors , 2005 .

[132]  W. Kalsbeek.  Sampling minority groups in health surveys , 2003, Statistics in medicine.

[133]  M. Greenwald,et al.  Just Say “I Don't”: Lack of Concordance Between Teen Report and Biological Measures of Drug Use , 2010, Pediatrics.

[134]  Seymour Sudman,et al.  Improving Interview Method and Questionnaire Design: Response Effects to Threatening Questions in Survey Research. , 1980 .

[135]  G. Gmel.  The effect of mode of data collection and of non-response on reported alcohol consumption: a split-sample study in Switzerland. , 2000, Addiction.

[136]  B. Freisthler,et al.  Does heavy drinking affect academic performance in college? Findings from a prospective study of high achievers. , 2003, Journal of studies on alcohol.

[137]  Emily M. Douglas,et al.  The effects of survey administration on disclosure rates to sensitive items among men: A comparison of an internet panel sample with a RDD telephone sample , 2010, Comput. Hum. Behav..

[138]  Sunghee Lee,et al.  Sampling Rare Populations , 2014 .

[139]  T. Jacob,et al.  Drinking problems of alcoholics: correspondence between self and spouse reports. , 1983, Addictive behaviors.

[140]  S. Blumberg,et al.  Telephone coverage and health survey estimates: evaluating the need for concern about wireless substitution. , 2006, American journal of public health.

[141]  Bruce D. Johnson,et al.  The Reliability and Validity of Drug Use Responses in a Large Scale Longitudinal Survey , 1975 .

[142]  C. Poulin,et al.  The validity of a province-wide student drug use survey: lessons in design. , 1993, Canadian journal of public health = Revue canadienne de sante publique.

[143]  Kypros Kypri,et al.  Assessment of nonresponse bias in an internet survey of alcohol use. , 2004, Alcoholism, clinical and experimental research.

[144]  J C Duffy,et al.  Under-reporting of alcohol consumption in sample surveys: the effect of computer interviewing in fieldwork. , 1984, British journal of addiction.

[145]  S. Blumberg,et al.  Reevaluating the need for concern regarding noncoverage bias in landline surveys. , 2009, American journal of public health.

[146]  T. I. Miller,et al.  Disguised and undisguised questionnaires compared: Two alternative approaches to drinking behaviour surveys , 2004, Social psychiatry.

[147]  C. Cowan.  Coverage, Sample Design, and Weighting in Three Federal Surveys , 2001 .

[148]  N. C. Schaeffer,et al.  Institute for Research on Poverty Discussion Paper no. 1024-93 Using Survey Participants to Estimate the Impact of Nonparticipation , 1993 .

[149]  K. Levy,et al.  An In-Depth Qualitative Examination of the Ecstasy Experience: Results of a Focus Group with Ecstasy-Using College Students , 2005, Substance use & misuse.

[150]  A. Lees,et al.  Cognitive performance in recreational users of MDMA or 'ecstasy': evidence for memory deficits , 1998, Journal of psychopharmacology.

[151]  M. Ramstedt.  How much alcohol do you buy? A comparison of self-reported alcohol purchases with actual sales. , 2010, Addiction.

[152]  G. Patton,et al.  Cannabis use and educational achievement: findings from three Australasian cohort studies. , 2010, Drug and alcohol dependence.

[153]  M. Fendrich,et al.  Decreased drug reporting in a cross-sectional student drug use survey. , 2000, Journal of substance abuse.

[154]  Toben F Nelson,et al.  Comparing web and mail responses in a mixed mode survey in college alcohol use research. , 2006, Addictive behaviors.

[155]  P. Kärkkäinen,et al.  Diary gives more accurate information about alcohol consumption than questionnaire. , 1983, Drug and alcohol dependence.

[156]  L. Johnston,et al.  Smoking, drinking, and drug use among American high school students: correlates and trends, 1975-1979. , 1981, American journal of public health.

[157]  Michael Fendrich,et al.  DIMINISHED LIFETIME SUBSTANCE USE OVER TIME: AN INQUIRY INTO DIFFERENTIAL UNDERREPORTING , 1994 .

[158]  L. Johnston,et al.  A Comparison of Confidential versus Anonymous Survey Procedures: Effects on Reporting of Drug Use and Related Attitudes and Beliefs in a National Study of Students , 2000 .

[159]  J. Chromy,et al.  Association Between Interviewer Experience and Substance Abuse Prevalence Rates in NSDUH , 2004 .

[160]  T. Naimi,et al.  US state alcohol sales compared to survey data, 1993-2006. , 2010, Addiction.

[161]  M. Slattery,et al.  Measurement errors stemming from nonrespondents present at in-person interviews. , 1998, Annals of epidemiology.

[162]  J. Ramirez-Valles,et al.  Social Integration and Health , 2010, Journal of health and social behavior.

[163]  C. Storr,et al.  Collecting substance use data with an anonymous mailed survey. , 1997, Drug and alcohol dependence.

[164]  R. Grucza,et al.  Discrepancies in estimates of prevalence and correlates of substance use and disorders between two national surveys. , 2007, Addiction.

[165]  M. Morgan.  Memory deficits associated with recreational use of “ecstasy” (MDMA) , 1999, Psychopharmacology.

[166]  L. Iversen,et al.  Alcohol consumption among laid-off workers before and after closure of a Danish ship-yard: a 2-year follow-up study. , 1986, Social science & medicine.

[167]  G. Gmel,et al.  Measuring alcohol consumption--should the 'graduated frequency' approach become the norm in survey research? , 2006, Addiction.

[168]  K. Strandberg-Larsen,et al.  Comparison of assessment methods for self-reported alcohol consumption in health interview surveys , 2008, European Journal of Clinical Nutrition.

[169]  R. Flewelling,et al.  The characterization of inconsistencies in self-reports of alcohol and marijuana use in a longitudinal study of adolescents. , 1992, Journal of studies on alcohol.

[170]  W Schmidt,et al.  Words and deeds: the validity of self-report data on alcohol consumption. , 1981, Journal of studies on alcohol.

[171]  M. Fendrich.  The undeniable problem of recanting. , 2005, Addiction.

[172]  V. Salomaa,et al.  Total and cause specific mortality among participants and non-participants of population based health surveys: a comprehensive follow up of 54 372 Finnish men and women , 2005, Journal of Epidemiology and Community Health.

[173]  Linda C. Sobell,et al.  Alcohol Consumption Measures , 1995 .

[174]  Xiaotong Han,et al.  Factors associated with perceived stigma for alcohol use and treatment among at-risk drinkers , 2004, The Journal of Behavioral Health Services & Research.

[175]  Douglas D. Heckathorn,et al.  Respondent-driven sampling II: deriving valid population estimates from chain-referral samples of hi , 2002 .

[176]  M. Traugott,et al.  Response Validity in Surveysof Voting Behavior , 1979 .

[177]  G. Tibblin.  A population study of 50-year-old men. An analysis of the non-participation group. , 2009, Acta medica Scandinavica.

[178]  C. Pérez,et al.  The validity of drug use responses in a household survey in Puerto Rico: comparison of survey responses with urinalysis. , 2010, Addictive behaviors.

[179]  C. Perry,et al.  The measurement of substance use among adolescents: when is the 'bogus pipeline' method needed? , 1987, Addictive behaviors.

[180]  Tim Stockwell,et al.  Understanding standard drinks and drinking guidelines. , 2012, Drug and alcohol review.

[181]  J. Strang,et al.  A review of biological indicators of illicit drug use, practical considerations and clinical usefulness. , 1999, Addiction.

[182]  B. Psaty,et al.  Race- and ethnicity-specific characteristics of participants lost to follow-up in a telephone cohort. , 1994, American journal of epidemiology.

[183]  A. Sharma,et al.  Sexual behavior of drug-users: is it different? , 2002, Preventive medicine.

[184]  Robert M. Groves,et al.  Nonresponse in Household Interview Surveys: Groves/Nonresponse , 1998 .

[185]  S. Weinberg,et al.  Classroom-based surveys of adolescent risk-taking behaviors: reducing the bias of absenteeism. , 2002, American journal of public health.

[186]  Roland S. Moore,et al.  Survey Nonresponse Bias Among Young Adults: The Role of Alcohol, Tobacco, and Drugs , 2005, Substance use & misuse.

[187]  S. Baggio,et al.  More is not always better-comparison of three instruments measuring volume of drinking in a sample of young men and their association with consequences. , 2014, Journal of studies on alcohol and drugs.

[188]  B. Gardner,et al.  Reflecting on non-reflective action: An exploratory think-aloud study of self-report habit measures , 2013, British journal of health psychology.

[189]  L. Mewton,et al.  Do young adults interpret the DSM diagnostic criteria for alcohol use disorders as intended? a cognitive interviewing study. , 2013, Alcoholism, clinical and experimental research.

[190]  P. Remington,et al.  A comparison of alcohol sales data with survey data on self-reported alcohol use in 21 states. , 1990, American journal of public health.

[191]  D. McCaffrey,et al.  Hardcore drug users claim to be occasional users: drug use frequency underreporting. , 2000, Drug and alcohol dependence.

[192]  M. Hilton,et al.  A comparison of a prospective diary and two summary recall techniques for recording alcohol consumption. , 1989, British journal of addiction.

[193]  W. Aquilino.  INTERVIEW MODE EFFECTS IN SURVEYS OF DRUG AND ALCOHOL USE: A FIELD EXPERIMENT , 1994 .

[194]  R. Bijl,et al.  The Netherlands Mental Health Survey and Incidence Study (NEMESIS): objectives and design , 1998, Social Psychiatry and Psychiatric Epidemiology.

[195]  S. Woodruff,et al.  Testing the Length of Time Theory of Recall Decay: Examining Substance Use Report Stability With 10 Years of National Longitudinal Survey of Youth Data , 2011, Substance use & misuse.

[196]  R. Smart,et al.  Validity and Reliahility of Self-Reported Drug Use , 1972 .

[197]  A. Mokdad,et al.  Prevalence of adult binge drinking: a comparison of two national surveys. , 2004, American journal of preventive medicine.

[198]  Charles E Matthews,et al.  The effect of social desirability and social approval on self-reports of physical activity. , 2005, American journal of epidemiology.

[199]  R. Groves,et al.  Survey Errors and Survey Costs. , 1991 .

[200]  F. J. Fowler,et al.  Learning from Experience: Estimating Teen Use of Alcohol, Cigarettes, and Marijuana from Three Survey Protocols , 2001 .

[201]  E. Fernández,et al.  Attrition in a population-based cohort eight years after baseline interview: The Cornella Health Interview Survey Follow-up (CHIS.FU) Study. , 2005, Annals of epidemiology.

[202]  Timothy P. Johnson,et al.  Examining Prevalence Differences in Three National Surveys of Youth: Impact of Consent Procedures, Mode, and Editing Rules , 2001 .

[203]  N. Solowij,et al.  The chronic effects of cannabis on memory in humans: a review. , 2008, Current drug abuse reviews.

[204]  S. Woodruff,et al.  Self-Reported Age of Onset and Telescoping for Cigarettes, Alcohol, and Marijuana: Across Eight Years of the National Longitudinal Survey of Youth , 2012, Journal of child & adolescent substance abuse.

[205]  N. Schwarz,et al.  Thinking About Answers: The Application of Cognitive Processes to Survey Methodology , 1995, Quality of Life Research.

[206]  R. Caetano,et al.  Characteristics of non-respondents in a US national longitudinal survey on drinking and intimate partner violence. , 2003, Addiction.

[207]  E. Oetting,et al.  Mexican American and white American school dropouts' drug use, health status, and involvement in violence. , 1989, Public health reports.

[208]  J. Clapp,et al.  Self-report stability of adolescent substance use: are there differences for gender, ethnicity and age? , 2000, Drug and alcohol dependence.

[209]  L. Midanik,et al.  Telephone versus in-person interviews for alcohol use: results of the 2000 National Alcohol Survey. , 2003, Drug and alcohol dependence.

[210]  J. Rehm,et al.  Measuring quantity, frequency, and volume of drinking. , 1998, Alcoholism, clinical and experimental research.

[211]  F. Chaloupka,et al.  EFFECT OF SURVEY CONDITIONS ON SELF-REPORTED SUBSTANCE USE , 1994 .

[212]  F. D. Del Boca,et al.  Truth or consequences: the validity of self-report data in health services research on addictions. , 2000, Addiction.

[213]  L. Balluz,et al.  Improving public health surveillance using a dual-frame survey of landline and cell phone numbers. , 2011, American journal of epidemiology.

[214]  M. Teichman,et al.  The reliability and consistency of self-reports on substance use in a longitudinal study. , 1987, British journal of addiction.

[215]  T. Johnson,et al.  Interviewer effects on self-reported substance use among homeless persons. , 1994, Addictive behaviors.

[216]  C. Steeh,et al.  Are They Really as Bad as They Seem? Nonresponse Rates at the End of the Twentieth Century , 2001 .

[217]  T. Johnson,et al.  Modeling sources of self-report bias in a survey of drug use epidemiology. , 2005, Annals of epidemiology.

[218]  T. Greenfield,et al.  Distribution of alcohol consumption and expenditures and the impact of improved measurement on coverage of alcohol sales in the 2000 National Alcohol Survey. , 2007, Alcoholism, clinical and experimental research.

[219]  L. Midanik,et al.  'Unstandard' ways of answering standard questions: protocol analysis in alcohol survey research. , 1991, Drug and alcohol dependence.

[220]  S. Blair,et al.  Patterns of non-response to a mail survey. , 1990, Journal of clinical epidemiology.

[221]  Justin Jager,et al.  Adolescent risk factors for adult alcohol use and abuse: stability and change of predictive value across early and middle adulthood. , 2008, Addiction.

[222]  K. Weinfurt,et al.  Contradictory subject response in longitudinal research. , 1996, Journal of studies on alcohol.

[223]  W. Hall.  What has research over the past two decades revealed about the adverse health effects of recreational cannabis use? , 2015, Addiction.

[224]  J. Clapp,et al.  The Stability of Self-Reported Marijuana Use across Eight Years of the National Longitudinal Survey of Youth , 2011, Journal of child & adolescent substance abuse.

[225]  S. Woodruff,et al.  Adolescent Alcohol Use Self-Report Stability: A Decade of Panel Study Data , 2010 .

[226]  T. Greenfield,et al.  Alcohol measurement methodology in epidemiology: recent advances and opportunities. , 2008, Addiction.

[227]  R. Bell,et al.  Does Early Drug Use Increase the Risk of Dropping out of High School? , 1998 .

[228]  R. Pihl,et al.  Patterns of Simultaneous Polysubstance Use in Canadian Rave Attendees , 2005, Substance use & misuse.

[229]  C. Spino,et al.  Assessment of drug abuser treatment needs in Rhode Island. , 1991, American journal of public health.

[230]  Gregory M Dominick,et al.  Using Cognitive Interviewing and Behavioral Coding to Determine Measurement Equivalence across Linguistic and Cultural Groups , 2011, Field methods.

[231]  Roger Tourangeau,et al.  Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines. , 1987 .

[232]  R. Room,et al.  WHO cross-cultural applicability research on diagnosis and assessment of substance use disorders: an overview of methods and selected results. , 1996, Addiction.

[233]  J. Gfroerer,et al.  Redesigning an Ongoing National Household Survey: Methodological Issues , 2002 .

[234]  A. Crawford.  Bias in a survey of drinking habits. , 1987, Alcohol and alcoholism.

[235]  J. Bauermeister,et al.  Innovative recruitment using online networks: lessons learned from an online study of alcohol and other drug use utilizing a web-based, respondent-driven sampling (webRDS) strategy. , 2012, Journal of studies on alcohol and drugs.

[236]  T. Johnson.  Sources of Error in Substance Use Prevalence Surveys , 2014, International scholarly research notices.

[237]  N. Schwarz.  Self-reports: How the questions shape the answers. , 1999 .

[238]  R. Engels,et al.  Correspondence in collateral and self-reports on alcohol consumption: a within family analysis. , 2007, Addictive behaviors.

[239]  S. Sudman,et al.  Validity of drug use reporting in a high-risk community sample: a comparison of cocaine and heroin survey reports with hair tests. , 1999, American journal of epidemiology.

[240]  H. Swadi.  Validating and Improving the Validity of Self-Reports in Adolescent Substance Misuse Surveys , 1990 .

[241]  H. Dubowitz,et al.  Comparison of 3 data collection methods for gathering sensitive and less sensitive information. , 2008, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[242]  R. K. Price,et al.  Comparison between self-report and hair analysis of illicit drug use in a community sample of middle-aged men. , 2008, Addictive behaviors.

[243]  D A Dawson,et al.  Volume of ethanol consumption: effects of different approaches to measurement. , 1998, Journal of studies on alcohol.

[244]  D. Kandel,et al.  UNDERREPORTING OF SUBSTANCE USE IN A NATIONAL LONGITUDINAL YOUTH COHORT INDIVIDUAL AND INTERVIEWER EFFECTS , 1988 .

[245]  W. Aquilino,et al.  Telephone versus face-to-face interviewing for household drug use surveys. , 1992, The International journal of the addictions.

[246]  L. Johnston,et al.  Reliability and consistency in self-reports of drug use. , 1983, The International journal of the addictions.

[247]  Courtney McKnight,et al.  Respondent-Driven Sampling in a Study of Drug Users in New York City: Notes from the Field , 2006, Journal of Urban Health.

[248]  L. Rips,et al.  The Psychology of Survey Response , 2000 .

[249]  Douglas D. Heckathorn,et al.  Respondent-driven sampling : A new approach to the study of hidden populations , 1997 .

[250]  K. Bucholz,et al.  Is a history of alcohol problems or of psychiatric disorder associated with attrition at 11-year follow-up? , 1996, Annals of epidemiology.

[251]  M. Hochhauser.  Bias in drug abuse survey research. , 1979, The International journal of the addictions.

[252]  O. Siddiqui,et al.  Characteristics of inconsistent respondents who have "ever used" drugs in a school-based sample. , 1999, Substance use & misuse.

[253]  A. Romelsjö.  The relationship between alcohol consumption and social status in Stockholm. Has the social pattern of alcohol consumption changed? , 1989, International journal of epidemiology.

[254]  E. Oetting,et al.  The effect of school dropout rates on estimates of adolescent substance use among three racial/ethnic groups. , 1997, American journal of public health.

[255]  Tom W. Smith,et al.  Motivation to Report Sensitive Behaviors on Surveys: Evidence From a Bogus Pipeline Experiment1 , 1997 .

[256]  Ivar Krumpal.  Determinants of social desirability bias in sensitive surveys: a literature review , 2013 .

[257]  Brady T. West,et al.  Selective nonresponse bias in population-based survey estimates of drug use behaviors in the United States , 2015, Social Psychiatry and Psychiatric Epidemiology.

[258]  Sadie Boniface,et al.  Drinking pattern is more strongly associated with under-reporting of alcohol consumption than socio-demographic factors: evidence from a mixed-methods study , 2014, BMC Public Health.

[259]  Lillian S. Lin,et al.  A Venue-Based Method for Sampling Hard-to-Reach Populations , 2001, Public health reports.

[260]  P. Wilson.  Improving the Methodology of Drinking Surveys , 1981 .

[261]  W. Friedman.  Memory for the time of past events. , 1993 .

[262]  T E Dielman,et al.  Validity of adolescents' self-reports of alcohol use and misuse using a bogus pipeline procedure. , 1987, Adolescence.

[263]  Tammy Chung,et al.  What were they thinking? Adolescents' interpretations of DSM-IV alcohol dependence symptom queries and implications for diagnostic validity. , 2005, Drug and alcohol dependence.

[264]  S. Macdonald,et al.  Non-response bias in alcohol and drug population surveys. , 2009, Drug and alcohol review.

[265]  H. Sahai,et al.  The validity of drug use responses in a household survey in Puerto Rico: comparison of survey responses of cocaine and heroin use with hair tests. , 2001, International journal of epidemiology.

[266]  Annette Leclerc,et al.  Health problems were the strongest predictors of attrition during follow-up of the GAZEL cohort. , 2006, Journal of clinical epidemiology.

[267]  J. Cunningham,et al.  Nonresponse in a follow-up to a representative telephone survey of adult drinkers. , 2001, Journal of studies on alcohol.

[268]  L. Cottler,et al.  Problem drinking among married men in India: comparison between husband's and wife's reports. , 2010, Drug and alcohol review.

[269]  R. Smart,et al.  A comparison of alcohol, tobacco and drug use as determined from household and school surveys. , 1985, Drug and Alcohol Dependence.

[270]  S L Warner,et al.  Randomized response: a survey technique for eliminating evasive answer bias. , 1965, Journal of the American Statistical Association.

[271]  P. Cooley,et al.  The Impact of T-ACASI Interviewing on Reported Drug Use among Men Who Have Sex with Men , 2000, Substance use & misuse.

[272]  T. Byers,et al.  Assessing alcohol consumption: beverage-specific versus grouped-beverage questions. , 1999, Journal of studies on alcohol.

[273]  I. White,et al.  Assessing the Representativeness of Population-Sampled Health Surveys Through Linkage to Administrative Data on Alcohol-Related Outcomes , 2014, American journal of epidemiology.

[274]  D. Korf,et al.  Temporal and Social Contexts of Heroin‐Using Populations An Illustration of the Snowball Sampling Technique , 1987, The Journal of nervous and mental disease.

[275]  Scott Davis,et al.  Implementation of the Women's Health Initiative study design. , 2003, Annals of epidemiology.

[276]  J. Parsons,et al.  Explanations for Methamphetamine Use Among Gay and Bisexual Men in New York City , 2005, Substance use & misuse.

[277]  Nancy D. Brener,et al.  The Association of Survey Setting and Mode with Self-Reported Health Risk Behaviors among High School Students , 2006 .

[278]  B. Grant,et al.  The Alcohol Use Disorder and Associated Disabilities Interview schedule (AUDADIS): reliability of alcohol and drug modules in a general population sample. , 1995, Drug and alcohol dependence.

[279]  R. Watten.  Coping styles in abstainers from alcohol. , 1996, Psychopathology.

[280]  S. Danish,et al.  Evaluation of data screening methods in surveys of adolescents' drug use. , 1991 .

[281]  Michael W. Link,et al.  Effects of survey mode on self-reports of adult alcohol consumption: a comparison of mail, web and telephone approaches. , 2005, Journal of studies on alcohol.

[282]  R. Dengler,et al.  Smoking and alcohol consumption in Trent, UK: an analysis of item non-response. , 1996, Journal of epidemiology and community health.

[283]  K. McElrath.  MDMA and Sexual Behavior: Ecstasy Users' Perceptions About Sexuality and Sexual Risk , 2005, Substance use & misuse.

[284]  T. Chikritzhs,et al.  What did you drink yesterday? Public health relevance of a recent recall method used in the 2004 Australian National Drug Strategy Household Survey. , 2008, Addiction.

[285]  P. Mäkelä,et al.  The effect of survey sampling frame on coverage: the level of and changes in alcohol-related mortality in Finland as a test case. , 2010, Addiction.

[286]  D. Nelson,et al.  A comparison of national estimates from the National Health Interview Survey and the Behavioral Risk Factor Surveillance System. , 2003, American journal of public health.

[287]  N. Martin,et al.  Participation bias in a sexuality survey: psychological and behavioural characteristics of responders and non-responders. , 1997, International journal of epidemiology.

[288]  L. Midanik.  The validity of self-reported alcohol consumption and alcohol problems: a literature review. , 1982, British journal of addiction.

[289]  K Poikolainen,et al.  Nature of questionnaire options affects estimates of alcohol intake. , 1985, Journal of studies on alcohol.

[290]  C. Delnevo,et al.  Declining estimated prevalence of alcohol drinking and smoking among young adults nationally: artifacts of sample undercoverage? , 2007, American journal of epidemiology.

[291]  T. Johnson,et al.  A venue analysis of predictors of alcohol use prior to sexual intercourse among female sex workers in Senggigi, Indonesia. , 2011, The International journal on drug policy.