Hypotheses in Marketing Science: Literature Review and Publication Audit

We examined three approaches to research in marketing: exploratory hypotheses, dominant hypothesis, and competing hypotheses. Our review of empirical studies on scientific methodology suggests that the use of a single dominant hypothesis lacks objectivity relative to the use of exploratory and competing hypotheses approaches. We then conducted a publication audit of over 1,700 empirical papers in six leading marketing journals during 1984–1999. Of these, 74% used the dominant hypothesis approach, while 13% used multiple competing hypotheses, and 13% were exploratory. Competing hypotheses were more commonly used for studying methods (25%) than models (17%) and phenomena (7%). Changes in the approach to hypotheses since 1984 have been modest; there was a slight decrease in the percentage of competing hypotheses to 11%, which is explained primarily by an increasing proportion of papers on phenomena. Of the studies based on hypothesis testing, only 11% described the conditions under which the hypotheses would apply, and dominant hypotheses were below competing hypotheses in this regard. Marketing scientists differed substantially in their opinions about what types of studies should be published and what was published. On average, they did not think dominant hypotheses should be used as often as they were, and they underestimated their use.

[1]  Kevin Dunbar,et al.  Concept Discovery in a Scientific Domain , 1993, Cogn. Sci..

[2]  P C Wason,et al.  Reasoning about a Rule , 1968, The Quarterly journal of experimental psychology.

[3]  M. Krafft An Empirical Investigation of the Antecedents of Sales Force Control Systems , 1999 .

[4]  W. Wells Discovery-oriented consumer research. , 1993 .

[5]  R. Goldfarb The economist-as-audience needs a methodology of plausible inference , 1995 .

[6]  J. Armstrong Prediction of Consumer Behavior by Experts and Novices , 1991 .

[7]  A. Greenwald,et al.  Under what conditions does theory obstruct research progress? , 1986, Psychological review.

[8]  Ian I. Mitroff,et al.  The Myth of Objectivity OR Why Science Needs a New Psychology of Science , 1972 .

[9]  Thomas O. Stair,et al.  Betrayers of the truth: Fraud and deceit in the halls of science , 1985 .

[10]  Hilary Farris,et al.  The Discovery Process: A Counterfactual Strategy , 1989 .

[11]  T. C. Chamberlin The Method of Multiple Working Hypotheses , 1931, The Journal of Geology.

[12]  Randall L. Schultz,et al.  A Study of Marketing Generalizations , 1980 .

[13]  L. Ross,et al.  Biased Assimilation and Attitude Polarization: The Effects of Prior Theories on Subsequently Considered Evidence , 1979 .

[14]  R. Charach The Appendix , 1948, The Lancet.

[15]  Edwin E. Wagner,et al.  Effect of positive findings on submission and acceptance rates: A note on meta-analysis bias. , 1986 .

[16]  Roger K. Blashfield,et al.  Performance of a composite as a function of the number of judges , 1978 .

[17]  J. Klayman,et al.  Hypothesis testing in rule discovery: Strategy, structure, and content. , 1989 .

[18]  J. Scott Armstrong,et al.  Are null results becoming an endangered species in marketing? , 1992 .

[19]  M. Gorman,et al.  A Comparison of Disconfirmatory, Confirmatory and Control Strategies on Wason's 2–4–6 Task , 1984 .

[20]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[21]  C. Fornell,et al.  Rational and Adaptive Performance Expectations in a Customer Satisfaction Framework , 1995 .

[22]  Prasad A. Naik,et al.  Planning Media Schedules in the Presence of Dynamic Advertising Quality , 1998 .

[23]  Developing, Disseminating, and Utilizing Marketing Knowledge , 1988 .

[24]  J. Scott Armstrong,et al.  Advocacy as a Scientific Strategy: The Mitroff Myth , 1980 .

[25]  Craig R. M. McKenzie,et al.  Taking into Account the Strength of an Alternative Hypothesis , 2001 .

[26]  C. Begg,et al.  Publication bias and dissemination of clinical research. , 1989, Journal of the National Cancer Institute.

[27]  M. Potter,et al.  Interference in Visual Recognition , 1964, Science.

[28]  V. Mittal,et al.  Attribute-Level Performance, Satisfaction, and Behavioral Intentions over Time: A Consumption-System Approach , 1999 .

[29]  Robin M. Hogarth,et al.  A note on aggregating opinions , 1978 .

[30]  J. Armstrong,et al.  Replications and Extensions in Marketing - Rarely Published But Quite Contrary , 1994 .

[31]  P. Wason On the Failure to Eliminate Hypotheses in a Conceptual Task , 1960 .

[32]  G. Ben-Shakhar,et al.  The effects of prior expectations and outcome knowledge on polygraph examiners' decisions , 1994 .

[33]  J. R. Bult,et al.  Optimal Selection for Direct Mail , 1995 .

[34]  K. Dunbar HOW SCIENTISTS REALLY REASON: SCIENTIFIC REASONING IN REAL-WORLD LABORATORIES , 1995 .

[35]  Gershon Ben-Shakhar,et al.  Seek and Ye Shall Find: Test Results Are What You Hypothesize They Are , 1998 .

[36]  Leonard D. Goodstein,et al.  Psychology of Scientist: XXX. Credibility of Psychologists: An Empirical Study , 1970 .

[37]  Lisa C . Troy,et al.  Order of Entry and Business Performance: An Empirical Synthesis and Reexamination , 1995 .

[38]  L. J. Chapman,et al.  Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. , 1969, Journal of abnormal psychology.

[39]  Richard E. Petty,et al.  The Low-Ball Compliance Technique: Task or Person Commitment? , 1981 .

[40]  Noel Capon,et al.  Cognitive Algebra in Multi-Attribute Attitude Models , 1975 .

[41]  Jacob Cohen The earth is round (p < .05) , 1994 .

[42]  J. Armstrong Research Needs in Forecasting , 1988 .

[43]  J. Armstrong Advocacy and Objectivity in Science , 1979 .

[44]  Clifford R. Mynatt,et al.  Consequences of Confirmation and Disconfirmation in a Simulated Research Environment , 1978 .

[45]  W. H. Jones,et al.  The selective processing of belief disconfirming information , 1980 .

[46]  Stephen I. Abramowitz,et al.  Publish or Politic: Referee Bias in Manuscript Review1 , 1975 .

[47]  J. Cacioppo,et al.  Low-ball procedure for producing compliance: Commitment then cost. , 1978 .

[48]  Deirdre N. McCloskey,et al.  The Standard Error of Regressions , 1996 .

[49]  Donald R. Lehmann,et al.  Estimating Publication Bias in Meta-Analysis , 1990 .

[50]  John E. Hunter,et al.  The Discard of Study Evidence by Literature Reviewers , 1994 .

[51]  Manoj K. Agarwal,et al.  An empirical comparison of consumer-based measures of brand equity , 1996 .

[52]  Chuan-Fong Shih,et al.  Smoking Scenes in Movies and Antismoking Advertisements before Movies: Effects on Youth , 1999 .

[53]  J. Koehler The Influence of Prior Beliefs on Scientific Judgments of Evidence Quality , 1993 .

[54]  F. Bass The Future of Research in Marketing: Marketing Science , 1993 .

[55]  Alan G. Sawyer,et al.  The Significance of Statistical Significance Tests in Marketing Research , 1983 .

[56]  L. Anderson,et al.  Marketing science: Where's the beef? , 1994 .

[57]  Raymond Hubbard,et al.  Does the need for agreement among reviewers inhibit the publication controversial findings? , 1991, Behavioral and Brain Sciences.

[58]  D. Wittink,et al.  Hierarchical versus other market share models for markets with many items , 1997 .