Let's Put Garbage-Can Regressions and Garbage-Can Probits Where They Belong

Many social scientists believe that dumping long lists of explanatory variables into linear regression, probit, logit, and other statistical equations will successfully “control” for the effects of auxiliary factors. Encouraged by convenient software and ever more powerful computing, researchers also believe that this conventional approach gives the true explanatory variables the best chance to emerge. The present paper argues that these beliefs are false, and that without intensive data analysis, linear regression models are likely to be inaccurate. Instead, a quite different and less mechanical research methodology is needed, one that integrates contemporary powerful statistical methods with deep substantive knowledge and classic data—analytic techniques of creative engagement with the data.

[1]  A. Goldman An Introduction to Regression Graphics , 1995 .

[2]  Russell D. Murphy,et al.  TOWARD A NEW POLITICAL METHODOLOGY: Microfoundations and ART , 2006 .

[3]  W. Cleveland,et al.  The Elements of Graphing Data. , 1988 .

[4]  Issei Fujishiro,et al.  The elements of graphing data , 2005, The Visual Computer.

[5]  Kevin A. Clarke The Phantom Menace: Omitted Variable Bias in Econometric Research , 2005 .

[6]  James Lee Ray,et al.  Explaining Interstate Conflict and War: What Should Be Controlled for? , 2003 .

[7]  J. M. Ridge The Quantitative Analysis of Social Problems , 1972 .

[8]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[9]  F. J. Anscombe,et al.  Graphs in Statistical Analysis , 1973 .

[10]  A. Fryer Political science as a science , 1965, Papers and Proceedings of the Royal Society of Tasmania.

[11]  S. Lewis,et al.  Regression analysis , 2007, Practical Neurology.

[12]  Bear F. Braumoeller Causal Complexity and the Study of Politics , 2003, Political Analysis.

[13]  J. Ray Constructing Multivariate Analyses (of Dangerous Dyads) , 2005 .

[14]  Graham Bell,et al.  A Comparative Method , 1989, The American Naturalist.

[15]  Anne E. Sartori An Estimator for Some Binary-Outcome Selection Models Without Exclusion Restrictions , 2003, Political Analysis.

[16]  R. Cook Regression Graphics , 1994 .

[17]  Curtis S. Signorino Strategic Interaction and the Statistical Analysis of International Conflict , 1999, American Political Science Review.

[18]  Bruce Russett,et al.  Rule of Three, Let It Be? When More Really Is Better , 2005 .

[19]  Harvey Starr,et al.  International Relations Theory, Foreign Policy Substitutability, and “Nice” Laws , 1984, World Politics.

[20]  Curtis S. Signorino,et al.  Strategic Misspecification in Regression Models , 2003 .

[21]  N. D. Pidgen,et al.  The Comparative Method , 1987 .

[22]  Larry M. Bartels Beyond the Running Tally: Partisan Bias in Political Perceptions , 2002 .