The Search for Reliable Generalizations about Messages: A Comparison of Research Strategies.

Two ways of conducting the search for generalizations about messages are considered: Morley's (this volume) proposal that single-message research designs be used, with subsequent meta-analytic summaries, and Jackson and Jacobs's (1983) proposal that multiple-message designs be used, with messages treated as a random factor in the statistical analysis. Jackson and Jacobs's approach is shown to provide a more dependable, efficient, and practical means for gathering the requisite evidence for dependable generalizations. The charge that multiple-message designs suffer from irreparable problems of experimenter bias is refuted. The treatment of messages as a random factor is defended as statistically appropriate and as clearly preferable to the statistical alternatives.

[1]  R. Rosenthal Meta-analytic procedures for social research , 1984 .

[2]  K. Tracy The Issue-Event Distinction: A Rule of Conversation and Its Scope Condition , 1983 .

[3]  Paul E. Spector,et al.  Meta-analysis for integrating study outcomes: A Monte Carlo study of its susceptibility to Type I and Type II errors. , 1987 .

[4]  K. Tracy The effect of multiple goals on conversational relevance and topic shift , 1984 .

[5]  Robert T. Craig,et al.  The discourse of requests assessment of a politeness approach , 1986 .

[6]  Sally Jackson,et al.  GENERALIZING ABOUT MESSAGES: SUGGESTIONS FOR DESIGN AND ANALYSIS OF EXPERIMENTS , 1983 .

[7]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[8]  Dean E. Hewes,et al.  Knowing when to 'second-guess': The mindful analysis of messages , 1986 .

[9]  James J. Bradac,et al.  A Molecular View of Powerful and Powerless Speech Styles. , 1984 .

[10]  S. Jackson,et al.  Are Compliance-Gaining Strategies Dependent on Situational Variables?. , 1982 .

[11]  M. Richter,et al.  ANOVA designs with subjects and stimuli as random effects: Applications to prototype effects on recognition memory. , 1987 .

[12]  Geoffrey Keppel,et al.  Discussion of Wike and Church's comments , 1976 .

[13]  K. Tracy,et al.  On Getting the Point: Distinguishing “Issues” from “Events,” An Aspect of Conversational Coherence , 1981 .

[14]  David M. Lane,et al.  Generalizing across stimuli as well as subjects: A neglected aspect of external validity. , 1985 .

[15]  L. Hedges,et al.  Meta-analysis: A review and a new view , 1986 .

[16]  S. Planalp Relational schemata: A test of alternative forms of relational knowledge as guides to communication. , 1985 .

[17]  Donald G. Ellis,et al.  Language and Speech Communication , 1982 .

[18]  Charles Pavitt,et al.  “SECOND‐GUESSING”: Message Interpretation in Social Networks , 1985 .

[19]  Thomas D. Wickens,et al.  On the choice of design and of test statistic in the analysis of experiments with sampled materials , 1983 .

[20]  R W Rogers,et al.  Fear appeals and attitude change: effects of a threat's noxiousness, probability of occurrence, and the efficacy of coping responses. , 1976, Journal of personality and social psychology.

[21]  H. H. Clark The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. , 1973 .

[22]  Robert T. Craig,et al.  THE DISCOURSE OF REQUESTS.: Assessment of a Compliance-Gaining Approach , 1984 .

[23]  A. Mulac,et al.  MALE/FEMALE LANGUAGE DIFFERENCES AND ATTRIBUTIONAL CONSEQUENCES IN CHILDREN'S TELEVISION , 1985 .

[24]  Paul R. Sackett,et al.  On seeking moderator variables in the meta-analysis of correlational data: A Monte Carlo investigation of statistical power and resistance to Type I error. , 1986 .

[25]  E. B. Coleman Generalizing to a Language Population , 1964 .

[26]  John L. Santa,et al.  Using Quasi F to prevent alpha inflation due to stimulus variation. , 1979 .

[27]  H. G. Osburn,et al.  Statistical power of tests of the situational specificity hypothesis in validity generalization studies: A cautionary note. , 1983 .

[28]  L. Hedges,et al.  Book Review: Meta Analysis: A Review and A New View , 1986 .

[29]  E. Edgington,et al.  Statistical inference and nonrandom samples. , 1966, Psychological bulletin.

[30]  J. Tukey,et al.  AVERAGE VALUES OF MEAN SQUARES IN FACTORIALS , 1956 .

[31]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .

[32]  Steven A. Mccornack,et al.  Message Design Logic and Message Goal Structure Effects on Perceptions of Message Quality in Regulative Communication Situations , 1987 .

[33]  Michael J. Schneider,et al.  Situation Perception and Message Strategy Selection , 1986 .

[34]  Characterizing Ordinary Argument: Substantive and Methodological Issues. , 1986 .

[35]  Sally Jackson,et al.  Conversational Relevance: Three Experiments on Pragmatic Connectedness in Conversation , 1987 .

[36]  James J. Bradac,et al.  Male/female language differences and attributional consequences in a public speaking situation: Toward an explanation of the gender‐linked language effect , 1986 .

[37]  Thomas J. Housel Conversational themes and attention focusing strategies: Predicting comprehension and recall , 1985 .

[38]  Judith M. Dallinger,et al.  Individual Differences in Cognitive Editing Standards , 1987 .

[39]  Cohesive Devices in Conversations. , 1987 .