Validation of Database Search Terms for Content Analysis: The Case of Cancer News Coverage

While databases are increasingly used for content analyses in mass communication and journalism research, concerns about sampling error have been largely ignored. We introduce a method to measure the quality of a search phrase according to two criteria: recall (its ability to accurately call up items of interest) and precision (ability to avoid extraneous ones). We present a detailed description of the evaluation procedure, offer an example of its use assessing an online search for news reports about cancer, and discuss limitations of the procedure and further potential uses.

[1]  Daniel Riffe,et al.  A Content Analysis of Content Analyses: Twenty-Five Years of Journalism Quarterly , 1997 .

[2]  Dhavan V. Shah,et al.  Elite Cues and Media Bias in Presidential Campaigns , 1999 .

[3]  J. A. Large,et al.  Manual of Online Search Strategies , 1988 .

[4]  Itzhak Yanovitzky,et al.  Mass Media, Social Norms, and Health Promotion Efforts , 2001, Commun. Res..

[5]  Alice Yanosko Chamis.  Vocabulary Control and Search Strategies in Online Searching , 1991 .

[6]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[7]  C. R. Hildreth,et al.  Intelligent Interfaces and Retrieval Methods for Subject Searching in Bibliographic Retrieval Systems , 1989 .

[8]  Glenn Leshner.  Research in Mass Communication: A Practical Guide , 2000 .

[9]  Dhavan V. Shah,et al.  News Media, Candidates and Issues, and Public Opinion in the 1996 Presidential Campaign , 1997 .

[10]  M. Lombard,et al.  Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability , 2002 .

[11]  Cynthia L. Blitz,et al.  Effect of media coverage and physician advice on utilization of breast cancer screening by women 40 years and older. , 2000, Journal of health communication.

[12]  Mike Conway,et al.  The Subjective Precision of Computers: A Methodological Comparison with Human Coding in Content Analysis , 2006 .

[13]  Dhavan V. Shah,et al.  Framing and the Public Agenda: Media Effects on the Importance of the Federal Budget Deficit , 1998 .

[14]  J. Stryker,et al.  Articles Media and Marijuana: A Longitudinal Analysis of News Media Effects on Adolescents' Marijuana Use and Related Outcomes, 1977-1999 , 2003, Journal of health communication.

[15]  Charles T. Meadow,et al.  Text information retrieval systems , 1992 .

[16]  J. Stryker.  A longitudinal analysis of the effects of news media messages on health behaviors , 2001 .

[17]  I. Yanovitzky,et al.  Effect of news coverage on the prevalence of drunk-driving behavior: evidence from a longitudinal study. , 2002, Journal of studies on alcohol.

[18]  Tom Koch,et al.  Journalism for the 21st Century: Online Information, Electronic Databases, and the News , 1991 .

[19]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .