Validity and reliability of self-reported drinking behavior: dealing with the problem of response bias.

This work assesses the validity and reliability of self-reported survey data on drinking behavior. There is evidence to suggest that data are adversely affected by bias from underreporting. This bias affects the validity of measures of consumption of alcohol and can have deleterious effects on the results of some forms of statistical estimation. Data for this study were collected at an isolated military base. The remoteness of this site and the fact that it is a military station made it possible to estimate the actual level of consumption of alcohol for the population by assessing apparent consumption through officially recorded sales of alcohol. The results of eight measures of consumption of alcohol were compared with apparent consumption, as established by documented sales, and the validity and reliability of the various measures were determined using the classical correlational approach. The validity and reliability of the data generated by the self-report survey were also analyzed using LISREL, the measurement model in particular. The results indicate that various instruments used to assess the consumption of alcohol produce very different outcomes in terms of their validity and reliability, some questions being considerably more valid and reliable than others. Two of the more salient characteristics of questions that affect validity and reliability were isolated, namely a question's ability to aid recall and its ability to mitigate the effects of persons providing socially desirable responses. The LISREL results show that these are two underlying factors for the measurement of the consumption of alcohol. It is concluded that questions that produce valid and reliable responses do so for identifiable reasons, and measurement instruments can be improved by incorporating particular features.

[1]  C. S. Mellor.  The epidemiology of alcoholism. , 1975, The British journal of psychiatry : the journal of mental science.

[2]  John C. Duffy,et al.  A Comparison of Computer Interviewing Techniques and Traditional Methods in the Collection of Self-Report Alcohol Consumption Data in a Field Survey , 1984 .

[3]  L. Sobell,et al.  Validity of self-reports in three populations of alcoholics. , 1978, Journal of consulting and clinical psychology.

[4]  L. Johnston,et al.  Reliability and consistency in self-reports of drug use. , 1983, The International journal of the addictions.

[5]  L. Sobell,et al.  Comparison of alcoholics' self-reports of drinking behavior with reports of collateral informants. , 1979, Journal of consulting and clinical psychology.

[6]  G A Marlatt,et al.  Verbal report methods in clinical research on alcoholism: response bias and its minimization. , 1987, Journal of studies on alcohol.

[7]  Seymour Sudman,et al.  Improving Interview Method and Questionnaire Design. , 1982 .

[8]  H. Annis.  Self-Report Reliability of Skid-Row Alcoholics , 1979, British Journal of Psychiatry.

[9]  P. Miller.  A behavioral intervention program for chronic public drunkenness offenders. , 1975, Archives of general psychiatry.

[10]  L. Midanik.  The validity of self-reported alcohol consumption and alcohol problems: a literature review. , 1982, British journal of addiction.

[11]  J C Duffy,et al.  Under-reporting of alcohol consumption in sample surveys: the effect of computer interviewing in fieldwork. , 1984, British journal of addiction.

[12]  Harrell Av,et al.  Validation of self-report: the research record. , 1985 .

[13]  H A Skinner,et al.  Reliability of alcohol use indices. The Lifetime Drinking History and the MAST. , 1982, Journal of studies on alcohol.

[14]  Paul E. Tracy,et al.  Randomized Response: A Method for Sensitive Surveys , 1986 .

[15]  J. Peto,et al.  Drinking in a London suburb. Reinterview of a subsample and assessment of response consistency. , 1973, Quarterly Journal of Studies on Alcohol.

[16]  L C Sobell,et al.  The reliability of alcohol abusers' self-reports of drinking and life events that occurred in the distant past. , 1988, Journal of studies on alcohol.

[17]  L. Sobell,et al.  Self-Report Issues in Alcohol Abuse: State of the Art and Future Directions , 1990 .

[18]  Bruce D. Johnson,et al.  The Reliability and Validity of Drug Use Responses in a Large Scale Longitudinal Survey , 1975 .

[19]  L. Sobell.  Critique of Alcoholism Treatment Evaluation , 1978 .

[20]  S. Maisto,et al.  The utility of self-report and biological measures of alcohol consumption in alcoholism treatment outcome studies , 1987 .

[21]  H A Skinner,et al.  Does the computer make a difference? Computerized versus face-to-face versus self-report assessment of alcohol, drug, and tobacco use. , 1983, Journal of consulting and clinical psychology.

[22]  S. Guze,et al.  The drinking history: a comparison of reports by subjects and their relatives. , 1963, Quarterly journal of studies on alcohol.

[23]  A. L. Edwards.  The social desirability variable in personality assessment and research , 1958 .

[24]  J. Ball.  The Reliability and Validity of Interview Data Obtained from 59 Narcotic Drug Addicts , 1967, American Journal of Sociology.

[25]  L. Midanik,et al.  Validity of self-reported alcohol use: a literature review and assessment. , 1988, British journal of addiction.

[26]  R S Ryback,et al.  The continuum and specificity of the effects of alcohol on memory. A review. , 1971, Quarterly journal of studies on alcohol.

[27]  C. Werch,et al.  Two procedures to reduce response bias in reports of alcohol consumption. , 1990, Journal of studies on alcohol.