Making the Most Of Statistical Analyses: Improving Interpretation and Presentation

Social Scientists rarely take full advantage of the information available in their statistical results. As a consequence, they miss opportunities to present quantities that are of greatest substantive interest for their research and express the appropriate degree of certainty about these quantities. In this article, we offer an approach, built on the technique of statistical simulation, to extract the currently overlooked information from any statistical method and to interpret and present it in a reader-friendly manner. Using this technique requires some expertise, which we try to provide herein, but its application should make the results of quantitative articles more informative and transparent. To illustrate our recommendations, we replicate the results of several published works, showing in each case how the authors' own conclusions can be expressed more sharply and informatively, and, without changing any data or statistical assumptions, how our approach reveals important new information about the research questions at hand. We also offer very easy-to-use Clarify software that implements our suggestions.

[1]  Michael Tomz,et al.  Electoral Surprise and the Midterm Loss in US Congressional Elections , 1999, British Journal of Political Science.

[2]  Glen G. Cain,et al.  Problems in Making Policy Inferences from the Coleman Report , 1970 .

[3]  William Vincent O'Brien.  War and/or survival , 1969 .

[4]  Ray C. Fair,et al.  Estimating the Expected Predictive Accuracy of Econometric Models , 1980 .

[5]  Bradley P. Carlin,et al.  BAYES AND EMPIRICAL BAYES METHODS FOR DATA ANALYSIS , 1996, Stat. Comput..

[6]  Tim Futing Liao,et al.  Bootstrapping: A Nonparametric Approach to Statistical Inference.@@@Maximum Likelihood Estimation: Logic and Practice. , 1995 .

[7]  Gary King,et al.  A Statistical Model for Multiparty Electoral Data , 1999, American Political Science Review.

[8]  V. Barnett,et al.  Comparative Statistical Inference (2nd ed.). , 1983 .

[9]  Steven J. Rosenstone,et al.  Mobilization, participation, and democracy in America , 1993 .

[10]  John D. Sterman,et al.  Path Dependence, Competition, and Succession in the Dynamics of Scientific Revolution , 1999 .

[11]  M. A. Tanner,et al.  Tools for Statistical Inference: Methods for the Exploration of Posterior Distributions and Likelihood Functions, 3rd Edition , 1998 .

[12]  Steven Stern,et al.  Simulation-based estimation , 1997 .

[13]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo in Practice: A Roundtable Discussion , 1998 .

[14]  J. Simon.  Resampling: The new statistics , 1995 .

[15]  G. Garrett,et al.  Partisan Politics in the Global Economy , 1998 .

[16]  S. T. Buckland,et al.  Computer-Intensive Methods for Testing Hypotheses. , 1990 .

[17]  C. D. Litton,et al.  Comparative Statistical Inference. , 1975 .

[18]  G. King,et al.  Unifying Political Methodology: The Likelihood Theory of Statistical Inference , 1989 .

[19]  Gary King,et al.  Logistic Regression in Rare Events Data , 2001, Political Analysis.

[20]  James A. McCann,et al.  Democratizing Mexico: Public Opinion and Electoral Choices , 1996 .

[21]  張仁豪,et al.  從本世紀之選舉回顧英國之民主憲政(Electoral Dynamics in Britain Since 1918) , 1981 .

[22]  J. A. Calvin.  Regression Models for Categorical and Limited Dependent Variables , 1998 .

[23]  Ray C Fairi.  ESTIMATING THE EXPECTED PREDICTIVE ACCURACY OF ECONOMETRIC MODELS BY RAY C . FAIRI , 1997 .

[24]  Hubert M. Blalock,et al.  Causal Inferences, Closed Populations, and Measures of Association , 1967, American Political Science Review.

[25]  Edward R. Tufte,et al.  Data Analysis for Politics and Policy , 1974 .

[26]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo conver-gence diagnostics: a comparative review , 1996 .

[27]  E. Ziegel,et al.  Bootstrapping: A Nonparametric Approach to Statistical Inference , 1993 .

[28]  Julian L. Simon,et al.  Probability and Statistics: Experimental Results of a Radically Different Teaching Method. , 1976 .

[29]  Randolph M. Siverson,et al.  War and the Survival of Political Leaders: A Comparative Study of Regime Types and Political Accountability , 1995, American Political Science Review.

[30]  C. Mooney.  Bootstrap Statistical Inference: Examples and Evaluations for Political Science , 1996 .