Message Variability and Heterogeneity: A Core Challenge for Communication Research

Messages pose fundamental challenges and opportunities for empirical communication research. To address these challenges and opportunities, we distinguish between message variability (the defined and operationalized features of messages in a given study) and message heterogeneity (all message features that are undefined and unmeasured in a given study), and suggest approaches to defining and operationalizing message variability. We also identify alternative message sampling, selection, and research design and analysis strategies responsive to issues of message variability and heterogeneity in experimental and survey research. We conclude with recommendations intended to advance the study of messages in communication research.

[1]  Michael D Slater,et al.  Content Analysis as a Foundation for Programmatic Research in Communication , 2013, Communication methods and measures.

[2]  John E. Hunter,et al.  The design and analysis of language experiments in communication , 1989 .

[3]  James J. Bradac,et al.  On Generalizing Cabbages, Messages, Kings, and Several Other Things: The Virtues of Multiplicity , 1983 .

[4]  Sally Jackson,et al.  GENERALIZING ABOUT MESSAGES: SUGGESTIONS FOR DESIGN AND ANALYSIS OF EXPERIMENTS , 1983 .

[5]  Martin Fishbein,et al.  Measuring Media Exposure: An Introduction to the Special Issue , 2008 .

[6]  Franziska Marquart,et al.  Communication and persuasion : central and peripheral routes to attitude change , 1988 .

[7]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[8]  Daniel J. O'Keefe,et al.  Message Properties, Mediating States, and Manipulation Checks: Claims, Evidence, and Data Analysis in Experimental Persuasive Message Effects Research , 2003 .

[9]  James J. Bradac,et al.  Threats to generalization in the use of elicited, purloined, and contrived messages in human communication research , 1986 .

[10]  M. Slater,et al.  Effects of alcohol advertising exposure on drinking among youth. , 2006, Archives of pediatrics & adolescent medicine.

[11]  Barbara J. Wilson,et al.  Mean on the Screen: Social Aggression in Programs Popular With Children , 2012 .

[12]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[13]  Daniel J. O'Keefe,et al.  The Search for Reliable Generalizations about Messages: A Comparison of Research Strategies. , 1988 .

[14]  Gary L. Wells,et al.  Stimulus Sampling and Social Psychological Experimentation , 1999 .

[15]  Daniel James O'Keefe.  Variability of persuasive message effects: Meta-analytic evidence and implications , 1999 .

[16]  John B. Nezlek,et al.  An Introduction to Multilevel Modeling for Social and Personality Psychology , 2008 .

[17]  Michael A. Shapiro.  Signal Detection Measures of Recognition Memory , 2014 .

[18]  Tom A. B. Snijders.  Power and Sample Size in Multilevel Linear Models , 2005 .

[19]  Jane D. Brown,et al.  Sexy Media Matter: Exposure to Sexual Content in Music, Movies, Television, and Magazines Predicts Black and White Adolescents' Sexual Behavior , 2006, Pediatrics.

[20]  M. Slater.  Operationalizing and Analyzing Exposure: The Foundation of Media Effects Research , 2004 .

[21]  Andy J. King,et al.  Why are Tailored Messages More Effective? A Multiple Mediation Analysis of a Breast Cancer Screening Intervention. , 2012, The Journal of communication.

[22]  M. Slater,et al.  Adolescent Responses to TV Beer ADS and Sports Content/Context: Gender and Ethnic Differences , 1997 .

[23]  Brian G. Southwell,et al.  Age, Memory Changes, and the Varying Utility of Recognition as a Media Effects Pathway , 2008 .

[24]  Michael D. Slater,et al.  Testing Alternative Explanations for Exposure Effects in Media Campaigns , 2002, Commun. Res..

[25]  Jakob D. Jensen,et al.  Conflicting stories about public scientific controversies: Effects of news convergence and divergence on scientists’ credibility , 2012, Public understanding of science.

[26]  J. Hox,et al.  Sufficient Sample Sizes for Multilevel Modeling , 2005 .

[27]  E. Bucy,et al.  The Mediated Moderation Model of Interactivity , 2007 .

[28]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[29]  R. Hornik,et al.  Can We Measure Encoded Exposure? Validation Evidence From a National Campaign , 2002, Journal of health communication.

[30]  M. Slater.  Use of Message Stimuli in Mass Communication Experiments: A Methodological Assessment and Discussion , 1991 .

[31]  Baruch Fischhoff,et al.  Judgment under uncertainty: Facts versus fears: Understanding perceived risk , 1982 .

[32]  A. Weaver,et al.  The (Non)Violent World of Youtube: Content Trends in Web Video (Top 3 Faculty Paper) , 2012 .

[33]  James D Sargent,et al.  Population-Based Assessment of Exposure to Risk Behaviors in Motion Pictures , 2008, Communication methods and measures.

[34]  Lindsay H. Hoffman.  When the World Outside Gets Inside Your Head , 2013, Commun. Res..

[35]  Marie Faerber,et al.  The Sage Sourcebook Of Advanced Data Analysis Methods For Communication Research , 2016 .

[36]  Michael D Slater,et al.  Increasing support for alcohol-control enforcement through news coverage of alcohol's role in injuries and crime. , 2012, Journal of studies on alcohol and drugs.

[37]  Andrew F. Hayes,et al.  A Primer on Multilevel Modeling , 2006 .

[38]  Catherine E. Goodall,et al.  Fear and Anger Responses to Local News Coverage of Alcohol-Related Crimes, Accidents, and Injuries: Explaining News Effects on Policy Support Using a Representative Sample of Messages and People. , 2013, Journal of Communications.

[39]  David Kenneth Berlo,et al.  The process of communication:an introduction to theory and practice , 1960 .

[40]  D. Solomon,et al.  The Effect of Relationship Characteristics and Relational Communication on Experiences of Hurt From Romantic Partners , 2012 .