Applications of Meta-Analysis for Marketing and Public Policy: A Review

Abstract The author examines the relevance of meta-analysis for research on marketing and public policy. He presents an overview of the history, benefits, and criticisms of meta-analysis; reviews and suggests meta-analysis applications; gives a nontechnical description of how to perform a meta-analysis; and concludes with implications of a “meta-analysis mindset” in the conduct and reporting of primary research studies.

[1]  Gerard J. Tellis,et al.  An Analysis of the Tradeoff between Advertising and Price Discounting , 1991 .

[2]  R. Petty.  The Evolution of Comparative Advertising Law: Has the Lanham Act Gone Too Far? , 1991 .

[3]  Cynthia Fraser,et al.  Meta-Analyses of Attitudes toward Advertising by Professionals , 1988 .

[4]  Molly Espey,et al.  Explaining the Variation in Elasticity Estimates of Gasoline Demand in the United States: A Meta-Analysis , 1996 .

[5]  Bruce L. Stern,et al.  An Analysis of Information Content in Television Advertising , 1977 .

[6]  Min-Sun Kim,et al.  Attitude-Behavior Relations: A Meta-Analysis of Attitudinal Relevance and Topic , 1993 .

[7]  A. Hunter,et al.  Multimethod Research: A Synthesis of Styles , 1989 .

[8]  J. Steenkamp,et al.  Generalizations about trust in marketing channel relationships using meta-analysis , 1998 .

[9]  M. Espey.  Gasoline demand revisited: an international meta-analysis of elasticities , 1998 .

[10]  A. L. Beaman,et al.  Fifteen Years of Foot-in-the Door Research , 1983 .

[11]  Franziska Marquart,et al.  Communication and persuasion : central and peripheral routes to attitude change , 1988 .

[12]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[13]  P. Sheeran,et al.  Predicting intentions to use condoms: a meta-analysis and comparison of the theories of reasoned action and planned behavior. , 1999 .

[14]  Emil J. Posavac,et al.  Peer-Based Interventions to Influence Health-Related Behaviors and Attitudes: A Meta-Analysis , 1999, Psychological reports.

[15]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[16]  D. Rubin,et al.  Comparing Effect Sizes of Independent Studies , 1982 .

[17]  S. Iyengar,et al.  Replicating Experiments Using Aggregate and Survey Data: The Case of Negative Advertising and Turnout , 1999, American Political Science Review.

[18]  James B. Stiff.  Cognitive processing of persuasive message cues: A meta‐analytic review of the effects of supporting information on attitudes , 1986 .

[19]  L. Swayne,et al.  The Portrayal of African-Americans in Business-To-Business Direct Mail: A Benchmark Study , 1999 .

[20]  Paul T. Costa,et al.  Reply to Eysenck , 1992 .

[21]  Dhruv Grewal,et al.  Comparative Price Advertising: An Integrative Review , 1998 .

[22]  David M. Szymanski,et al.  Identifying the Generics-Prone Consumer: A Meta-Analysis , 1987 .

[23]  Ingram Olkin,et al.  Stochastically dependent effect sizes. , 1994 .

[24]  Adrian Furnham,et al.  A Cross-Cultural Content Analysis of Sex-Role Stereotyping in Television Advertisements: A Comparison Between Great Britain and New Zealand , 2000 .

[25]  Steven P. Brown,et al.  A Meta-Analysis of Relationships between Ad-Evoked Feelings and Advertising Responses , 1998 .

[26]  Martin T. Wells,et al.  USING RANDOM RATHER THAN FIXED EFFECTS MODELS IN META‐ANALYSIS: IMPLICATIONS FOR SITUATIONAL SPECIFICITY AND VALIDITY GENERALIZATION , 1996 .

[27]  Edward E. Leamer,et al.  Let's Take the Con Out of Econometrics , 1983 .

[28]  D. O’Keefe.  Extracting dependable generalizations from the persuasion effects literature: Some issues in meta-analytic reviews , 1991 .

[29]  Richard F. Beltramini,et al.  Meta-Analysis: Quantitative Methods for Research Synthesis , 1987 .

[30]  M. Mazis.  Marketing and Public Policy: Prospects for the Future , 1997 .

[31]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[32]  D. Clarke.  Econometric Measurement of the Duration of Advertising Effect on Sales , 1976 .

[33]  Charles r. Taylor,et al.  Portrayals of Latinos in Magazine Advertising , 1997 .

[34]  Susan C. Borkowski,et al.  Business Students and Ethics: A Meta-Analysis , 1998 .

[35]  Ingram Olkin,et al.  Analyses, reanalyses, and meta-analyses , 1982 .

[36]  George R. Franke,et al.  Gender differences in ethical perceptions of business practices: a social role theory perspective. , 1997, The Journal of applied psychology.

[37]  Charles V. Trappey,et al.  A Meta-Analysis of Consumer Choice and Subliminal Advertising , 1996 .

[38]  Mike Allen,et al.  Television Programming and Sex Stereotyping: A Meta-Analysis , 1996 .

[39]  Stephen W. Raudenbush,et al.  Random effects models. , 1994 .

[40]  Linda S. Franck,et al.  Integrating Research: A Guide for Literature Reviews (2nd ed.). By H. M. Cooper. 157 pp. Newbury Park, CA Sage Publications, 1989, $19.95 , 1990 .

[41]  J. Calfee,et al.  The Informational Content of Cigarette Advertising: 1926–1986 , 1989 .

[42]  M. Fishbein,et al.  Theories of reasoned action and planned behavior as models of condom use: a meta-analysis. , 2001, Psychological bulletin.

[43]  J. Zhang,et al.  Vaginal douching and adverse health effects: a meta-analysis. , 1997, American journal of public health.

[44]  J. Bettman.  An information processing theory of consumer choice , 1979 .

[45]  Blair T. Johnson,et al.  Involvement and Persuasion: Types, Traditions, and the Evidence , 1990 .

[46]  Michael Schulte-Mecklenbeck,et al.  The Effects of Framing, Reflection, Probability, and Payoff on Risk Preference in Choice Tasks. , 1999, Organizational behavior and human decision processes.

[47]  Jeff Frooman,et al.  Socially Irresponsible and Illegal Behavior and Shareholder Wealth , 1997 .

[48]  Nancy B. Kurland.  Ethical Intentions and the Theories of Reasoned Action and Planned Behavior1 , 1995 .

[49]  A. Kühberger,et al.  The Influence of Framing on Risky Decisions: A Meta-analysis. , 1998, Organizational behavior and human decision processes.

[50]  Abagail McWilliams,et al.  Event Studies In Management Research: Theoretical And Empirical Issues , 1997 .

[51]  John T. Cacioppo,et al.  Involvement and Persuasion: Tradition Versus Integration , 1990 .

[52]  David M. Szymanski,et al.  Customer satisfaction: A meta-analysis of the empirical evidence , 2001 .

[53]  P. Sheeran,et al.  Prediction and Intervention in Health-Related Behavior: A Meta-Analytic Review of Protection Motivation Theory , 2000 .

[54]  Blair T. Johnson.  DSTAT : software for the meta-analytic review of research literatures , 1992 .

[55]  Kent B. Monroe,et al.  Effect-Size Estimates: Issues and Problems in Interpretation , 1996 .

[56]  J. Shanahan,et al.  Alcohol portrayal on prime-time television: manifest and latent messages. , 1998, Journal of studies on alcohol.

[57]  L. Hedges,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[58]  R. W. Rogers,et al.  A Protection Motivation Theory of Fear Appeals and Attitude Change1. , 1975, The Journal of psychology.

[59]  Richard R. Lau,et al.  The Effects of Negative Political Advertisements: A Meta-Analytic Assessment , 1999, American Political Science Review.

[60]  Bernard J. Jaworski,et al.  Information Processing from Advertisements: Toward an Integrative Framework , 1989 .

[61]  L. R. Hayes.  Are Prices Higher for the Poor in New York City? , 2000 .

[62]  John E. Hunter,et al.  Comparison of Three Meta-Analysis Methods Revisited: An Analysis of Johnson, Mullen, and Salas (1995) , 1999 .

[63]  Blair T. Johnson,et al.  Gender and Leadership Style: A Meta-Analysis , 1990 .

[64]  Rick L. Andrews,et al.  The Determinants of Cigarette Consumption: A Meta-Analysis , 1991 .

[65]  Thomas D. Cook,et al.  Threats to the validity of research syntheses , 1994 .

[66]  D. Ones,et al.  Theory testing: Combining psychometric meta-analysis and structural equations modeling , 1995 .

[67]  R. Collins,et al.  The modeling of alcohol consumption: a meta-analytic review. , 1999, Journal of studies on alcohol.

[68]  Judith A. Hall,et al.  Interpreting and Evaluating Meta-Analysis , 1995, Evaluation & the health professions.

[69]  Abhijit Biswas,et al.  Reference pricing studies in marketing: A synthesis of research results , 1993 .

[70]  Min-Sun Kim,et al.  Relationships Among Attitudes, Behavioral Intentions, and Behavior , 1993 .

[71]  M. L. Smith,et al.  Meta-analysis of psychotherapy outcome studies. , 1977, The American psychologist.

[72]  Sharon Vaughn,et al.  Contemporary Special Education Research : Syntheses of the Knowledge Base on Critical Instructional Issues , 2000 .

[73]  S. J. Kraus,et al.  Attitudes and the Prediction of Behavior: A Meta-Analysis of the Empirical Literature , 1990 .

[74]  B. Ratchford,et al.  Consumer information search revisited: Theory and empirical analysis , 1997 .

[75]  D. Buller.  Distraction during persuasive communication: A meta‐analytic review , 1986 .

[76]  M. Allen,et al.  A Meta-Analysis of Fear Appeals: Implications for Effective Public Health Campaigns , 2000, Health education & behavior : the official publication of the Society for Public Health Education.

[77]  G. Tellis.  The Price Elasticity of Selective Demand: A Meta-Analysis of Econometric Models of Sales , 1988 .

[78]  R. Moos,et al.  Consistency of self-administered and interview-based Addiction Severity Index composite scores. , 2000, Addiction.

[79]  M. Slater,et al.  The Use of Human Models and Cartoon Characters in Magazine Advertisements for Cigarettes, Beer, and Nonalcoholic Beverages , 2000 .

[80]  John T. Cacioppo,et al.  Source and message factors in persuasion: A reply to stiff's critique of the elaboration likelihood model , 1987 .

[81]  V. Mahajan,et al.  Diffusion of New Products: Empirical Generalizations and Managerial Uses , 1995 .

[82]  Kent B. Monroe,et al.  Effectiveness of Multiple Request Strategies: A Synthesis of Research Results , 1986 .

[83]  H. Cooper,et al.  A Quantitative Review of Research Design Effects on Response Rates to Questionnaires , 1983 .

[84]  Robert L. Bangert-Drowns,et al.  Review of developments in meta-analytic method. , 1986 .

[85]  Deborah Roedder John.  Consumer Socialization of Children: A Retrospective Look at Twenty-Five Years of Research , 1999 .

[86]  U. Karmarkar.  Integrative Research in Marketing and Operations Management , 1996 .

[87]  Robert L. Bangert-Drowns,et al.  Misunderstanding Meta-Analysis , 1995, Evaluation & the health professions.

[88]  J. McGrath,et al.  External Validity and the Research Process: A Comment on the Calder/Lynch Dialogue , 1983 .

[89]  MahajanVijay,et al.  Diffusion of New Products , 1995 .

[90]  Peter S. H. Leeflang,et al.  The changing consumer in the European Union: A 'meta-analysis.' , 1995 .

[91]  Deborah Gunthorpe.  Business Ethics: A Quantitative Analysis of the Impact of Unethical Behavior by Publicly Traded Corporations , 1997 .

[92]  Blair T. Johnson.  Insights about Attitudes: Meta-Analytic Perspectives , 1991 .

[93]  John P. Wanous,et al.  The role of judgment calls in meta-analysis. , 1989 .

[94]  John B. Willett,et al.  The visual presentation and interpretation of meta-analyses. , 1994 .

[95]  Betsy Jane Becker,et al.  Examining explanatory models through research synthesis. , 1994 .

[96]  I. Ajzen,et al.  Predicting dishonest actions using the theory of planned behavior , 1991 .

[97]  Leonard M. Lodish,et al.  A Summary of Fifty-Five In-Market Experimental Estimates of the Long-Term Effect of TV Advertising , 1995 .

[98]  Dick R. Wittink,et al.  Empirical Generalizations About the Impact of Advertising on Price Sensitivity and Price , 1995 .

[99]  Robert G. Orwin,et al.  EVALUATING CODING DECISIONS , 2019, The Handbook of Research Synthesis and Meta-Analysis.

[100]  L. Hedges,et al.  From Evidence to Knowledge to Policy: Research Synthesis for Policy Formation , 1993 .

[101]  Meni Koslowsky,et al.  DETECTING MODERATORS WITH META‐ANALYSIS: AN EVALUATION AND COMPARISON OF TECHNIQUES , 1993 .

[102]  Dominique M. Hanssens,et al.  The Category-Demand Effects of Price Promotions , 2000 .

[103]  A. Eagly,et al.  Sex of researchers and sex-typed communications as determinants of sex differences in influenceability: A meta-analysis of social influence studies , 1981 .

[104]  G. Kalyanaram,et al.  Empirical Generalizations from Reference Price Research , 1995 .

[105]  Daniel L. Sherrell,et al.  Source effects in communication and persuasion research: A meta-analysis of effect size , 1993 .

[106]  W. Bruvold,et al.  A meta-analysis of adolescent smoking prevention programs. , 1993, American journal of public health.

[107]  Frank L. Schmidt,et al.  What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. , 1992 .

[108]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[109]  R. Rosenthal.  The file drawer problem and tolerance for null results , 1979 .

[110]  Blair T. Johnson,et al.  Effects of involvement on persuasion: a meta-analysis , 1989 .

[111]  Blair T. Johnson,et al.  Comparison of three major meta-analytic approaches. , 1995 .

[112]  J. Farley,et al.  Meta-Analysis in Marketing: Generalization of Response Models , 1986 .

[113]  Hale N. Tongren.  Determinant Behavior Characteristics of Older Consumers , 1988 .

[114]  C. Begg,et al.  Publication bias : a problem in interpreting medical data , 1988 .

[115]  Raymond W. Preiss,et al.  Persuasion : advances through meta-analysis , 1998 .

[116]  John E. Hunter,et al.  Sequential-request persuasive strategies: Meta-analysis of foot-in-the-door and door-in-the-face. , 1984 .

[117]  Robert P. Leone.  Generalizing What Is Known About Temporal Aggregation and Advertising Carryover , 1995 .

[118]  Mike Allen,et al.  Meta‐analysis comparing the persuasiveness of one‐sided and two‐sided messages , 1991 .

[119]  Donald R. Lehmann,et al.  Designing the Next Study for Maximum Impact , 1998 .

[120]  Leonard M. Lodish,et al.  How T.V. Advertising Works: A Meta-Analysis of 389 Real World Split Cable T.V. Advertising Experiments , 1995 .

[121]  Steven P. Brown,et al.  Antecedents and Consequences of Attitude toward the Ad: A Meta-analysis , 1992 .

[122]  D. B. Wilson,et al.  Meta-analyses in alcohol and other drug abuse treatment research. , 2000, Addiction.

[123]  George R. Franke,et al.  FTC Regulatory Activity and the Information Content of Advertising , 1998 .

[124]  David B. Pillemer,et al.  Summing Up: The Science of Reviewing Research , 1984 .

[125]  Dean M. Krugman,et al.  Teenage Exposure to Cigarette Advertising in Popular Consumer Magazines , 2000 .

[126]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[127]  Betty J. Diener,et al.  The Frequency and Context of Alcohol and Tobacco Cues in Daytime Soap Opera Programs: Fall 1986 and Fall 1991 , 1993 .

[128]  James J. Kellaris,et al.  Framing and situational ethics , 1994 .

[129]  L. Ross,et al.  The “false consensus effect”: An egocentric bias in social perception and attribution processes , 1977 .

[130]  Thomas A. Louis,et al.  Meta-Analysis for Explanation: A Casebook. , 1992 .

[131]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[132]  Donald R. Lehmann,et al.  Estimating Publication Bias in Meta-Analysis , 1990 .

[133]  Dhruv Grewal,et al.  Comparative Versus Noncomparative Advertis-ing: A Meta-Analysis , 1997 .

[134]  Donald R. Lehmann,et al.  Cross-national “laws” and differences in market response , 1994 .

[135]  D. MacInnis,et al.  Characteristics of portrayed emotions in commercials: when does what is shown in ads affect viewers? , 1995 .

[136]  Randall P. Settoon,et al.  Investigator characteristics as moderators of personnel selection research: a meta-analysis , 1994 .

[137]  Rosemary J. Avery,et al.  Verisimilitude or Advertising? Brand Appearances on Prime-Time Television , 2000 .

[138]  Blair H. Sheppard,et al.  The Theory of Reasoned Action: A Meta-Analysis of Past Research with Recommendations for Modifications and Future Research , 1988 .

[139]  R. W. Rogers,et al.  A meta-analysis of research on protection motivation theory. , 2000 .

[140]  Robert Rosenthal.  WRITING META-ANALYTIC REVIEWS , 1995 .

[141]  Ingrid M. Martin,et al.  Intended and Unintended Consequences of Warning Messages: A Review and Synthesis of Empirical Research , 1994 .

[142]  Donald R. Lehmann,et al.  Empirical Marketing Generalization Using Meta-Analysis , 1995 .

[143]  J. Farley,et al.  How Advertising Affects Sales: Meta-Analysis of Econometric Results , 1984 .

[144]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[145]  Donald R. Lehmann,et al.  The impact of research design on consumer price recall accuracy: An integrative review , 2001 .

[146]  John E. Calfee,et al.  The 70% Majority: Enduring Consumer Beliefs about Advertising , 1994 .

[147]  Donald R. Lehmann,et al.  A Meta-Analysis of Applications of Diffusion Models , 1990 .

[148]  Michael S. Wogalter,et al.  Do Product Warnings Increase Safe Behavior? A Meta-Analysis , 1997 .

[149]  H. Eysenck.  An exercise in mega-silliness. , 1978 .

[150]  M. C. Martin.  Children's Understanding of the Intent of Advertising: A Meta-Analysis , 1997 .

[151]  Raj Sethuraman,et al.  A meta-analysis of national brand and store brand cross-promotional price elasticities , 1995 .

[152]  Larry V. Hedges,et al.  Fixed-Effects Models , 2022, The SAGE Encyclopedia of Research Design.

[153]  Hans Georg Gemünden,et al.  Perceived risk and information search. A systematic meta-analysis of the empirical evidence , 1985 .