Reliability in Cross-National Content Analysis

Cross-national assessment of coding reliability and its methodological problems have largely been neglected. In an exploratory first study and a more elaborate second study, we investigated how coder characteristics such as language skills, political knowledge, coding experience, and coding certainty affected inter-coder and coder-trainer reliability. The second study showed that language skills influenced both reliability types, albeit mediated by coding certainty. Politically knowledgeable coders coded more reliably, while coding experience did not affect reliability. Overall, the results suggest that cross-national researchers pay more attention to cross-national assessment of reliability.

[1]  Daniel Riffe,et al.  A Content Analysis of Content Analyses: Twenty-Five Years of Journalism Quarterly , 1997 .

[2]  W. Bennett,et al.  For whom the gates open: News reporting and government source patterns in the United States, Great Britain, and Russia , 1995 .

[3]  L. L. Kaid,et al.  Political Television Advertising in Western Democracies: A Comparison of Campaign Broadcasts in the United States, Germany, and France , 1994 .

[4]  J. Peter,et al.  Framing Politics at the Launch of the Euro: A Cross-National Comparative Study of Frames in the News , 2001 .

[5]  K. Siune,et al.  The Role of Television in European Elections: The Cases of Belgium and Denmark , 1994 .

[6]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[7]  Barbara Mueller,et al.  Standardization vs. specialization: An examination of Westernization in Japanese advertising. , 1992 .

[8]  W. James Potter,et al.  Rethinking validity and reliability in content analysis , 1999 .

[9]  THE DEPICTION OF SEX ROLES IN AMERICAN AND GERMAN MAGAZINE ADVERTISEMENTS , 1991 .

[10]  D. Kevin.  Coverage of the European Parliament Elections of 1999: National Public Spheres and European Debates , 2001 .

[11]  T. Chang,et al.  The social construction of international imagery in the Post‐Cold War Era: A comparative analysis of U.S. and Chinese national TV news , 1998 .

[12]  Susan T. Fiske,et al.  On the Varieties and Utilities of Political Expertise , 1990 .

[13]  P. Valkenburg,et al.  Framing European politics: a content analysis of press and television news , 2000 .

[14]  Barbara Mueller,et al.  Reflections of Culture: An Analysis of Japanese and American Advertising Appeals. , 1986 .

[15]  A Cross-Cultural Study of Political Advertising in the United States and Korea , 1997 .

[16]  J. B. Haskins,et al.  Reliability of the News Direction Scale for Analysis of the Good-Bad News Dimension , 1984 .

[17]  K. Merten.  Reactivity in Content Analysis , 1996 .