The State of Experimental Research in IR: An Analytical Survey

The purpose of this review essay is to examine the use of experimental methods and its contributions to international studies research. Following a general discussion of the experimental approach, including the advantages and disadvantages of experimentation in International Relations (IR), this review moves to a categorized discussion of the ways in which experimental methods have contributed to the field of international studies. By invoking economist Alvin Roth's three purposes of experiments—searching for facts, speaking to theorists, and influencing policy debates—this classification scheme helps to identify the overarching purposes of a wide variety of experiments in the field. However, this review seeks to move beyond merely presenting a basic review of the copious experimental literature by also providing an analytical assessment of the function that experimentation serves in IR; that is, to identify and elaborate on experimental research that serves an integrative function, as a bridge across the multiple divides in the landscape of IR. To this end, we introduce a second and original classification framework that allows us to profile in detail a number of singularly significant experimental studies. We then conclude the analysis by highlighting a set of “growth areas” for experimental research that can maintain and expand the already significant contributions of experimental methods to our field.

[1]  Zeev Maoz,et al.  Alliance, contiguity, wealth, and political stability: Is the lack of conflict among democracies a statistical artifact? 1 , 1992 .

[2]  Daniel Druckman,et al.  Ethnocentrism in the Inter-Nation Simulation , 1968 .

[3]  Torney-Purta Evaluating Programs Designed to Teach International Content and Negotiation Skills , 1998 .

[4]  Sarit Kraus,et al.  An Automated Agent for Bilateral Negotiation with Bounded Rational Agents with Incomplete Information , 2006, ECAI.

[5]  A. Mintz Behavioral IR as a Subfield of International Relations , 2007 .

[6]  R. McDermott Experimental Methodology in Political Science , 2002, Political Analysis.

[7]  Sam Whitt,et al.  The Dictator Game, Fairness and Ethnicity in Postwar Bosnia , 2007 .

[8]  R. Jervis Perception and misperception in international politics , 1976 .

[9]  T. Schelling The strategy of conflict . Prospectus for a reorientation of game theory , 1958 .

[10]  Steven B. Redd,et al.  Bureaucrats Versus the Ballot Box in Foreign Policy Decision Making , 2004 .

[11]  J. Kagel,et al.  Handbook of Experimental Economics , 1997 .

[12]  Léonard Wantchekon,et al.  Clientelism and Voting Behavior: Evidence from a Field Experiment in Benin , 2003 .

[13]  I. W. Zartman,et al.  Power and negotiation , 2000 .

[14]  William A. Boettcher The Prospects for Prospect Theory: An Empirical Evaluation of International Relations Applications of Framing and Loss Aversion , 2004 .

[15]  David A. Bositis,et al.  A synoptic history and typology of experimental research in political science , 1987 .

[16]  James H. Kuklinski,et al.  The Growth and Development of Experimental Research in Political Science , 2006, American Political Science Review.

[17]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[18]  Scott W. Brown,et al.  Communication: Educating for global awareness: implications for governance and generational change , 2004 .

[19]  Daniel Druckman,et al.  Boundary Role Conflict , 1977 .

[20]  Arnold Vedlitz,et al.  Issue Definition, Information Processing, and the Politics of Global Warming , 2007 .

[21]  Bruce Bueno de Mesquita,et al.  War and Reason , 1992 .

[22]  James W. Polichak,et al.  Explicating the Black Box Through Experimentation: Studies of Authoritarianism and Threat , 2002, Political Analysis.

[23]  Ifat Maoz,et al.  An Experiment in Peace: Reconciliation-Aimed Workshops of Jewish-Israeli and Palestinian Youth , 2000 .

[24]  A. Mcalister Moral Disengagement: Measurement and Modification , 2001 .

[25]  David P. Biros,et al.  The Influence of Task Load and Automation Trust on Deception Detection , 2004 .

[26]  Sarit Kraus,et al.  Resolving crises through automated bilateral negotiations , 2008, Artif. Intell..

[27]  S. Rosen,et al.  Testosterone and Aggression in a Simulated Crisis Game , 2007 .

[28]  Nehemia Geva,et al.  Why Don't Democracies Fight Each Other? , 1993 .

[29]  W. Masters,et al.  The Role of Leaders in Democratic Deliberations: Results from a Field Experiment in São Tomé and Príncipe , 2006 .

[30]  Scott W. Brown,et al.  Experimenting with global governance: understanding the potential for generational change , 2007 .

[31]  Stephen J. Majeski,et al.  How foreign policy recommendations are put together: A computational model with empirical applications , 1999 .

[32]  J. Carpenter Bargaining Outcomes as the Result of Coordinated Expectations , 2003 .

[33]  Daniel Druckman,et al.  The Situational Levers of Negotiating Flexibility , 1993 .

[34]  Alice F. Healy,et al.  Peace Agreement, Intractable Conflict, Escalation Trajectory: A Psychological Laboratory Experiment , 1995 .

[35]  Dominic D. P. Johnson,et al.  Overconfidence in wargames: experimental evidence on expectations, aggression, gender and testosterone , 2006, Proceedings of the Royal Society B: Biological Sciences.

[36]  Sarit Kraus,et al.  The Impact of Cognitive Diversity on Crisis Negotiations , 1998 .

[37]  Thomas R. Palfrey,et al.  Experimental foundations of political science , 1993 .

[38]  Richard Harris,et al.  Computer-Assisted International Negotiation: A Tool for Research and Practice , 2002 .

[39]  Andreas Diekmann,et al.  The Power of Reciprocity , 2004 .

[40]  T. Ostrom,et al.  Case-Based, Model-Based, and Explanation-Based Styles of Reasoning in Foreign Policy , 1994 .

[41]  E. Miguel Tribe or Nation?: Nation Building and Public Goods in Kenya versus Tanzania , 2004 .

[42]  Rick L. Riolo,et al.  Behavioural evolution (Communication arising): Does similarity breed cooperation? , 2002, Nature.

[43]  B. Brock-utne,et al.  Gender and Cooperation in the Laboratory , 1989 .

[44]  Rick L. Riolo,et al.  Beyond Geography: Cooperation with Persistent Links in the Absence of Clustered Neighborhoods , 2002 .

[45]  T. Clifton Morgan,et al.  Domestic Structure, Decisional Constraints, and War , 1991 .

[46]  R. Axelrod,et al.  How to Cope with Noise in the Iterated Prisoner's Dilemma , 1995 .

[47]  D. G. Pruitt Field Experiments on Social Conflict , 2005 .

[48]  Steven B. Redd The Influence of Advisers on Foreign Policy Decision Making , 2002 .

[49]  Helen V. Milner,et al.  Interests, Institutions, and Information: Domestic Politics and International Relations , 2020 .

[50]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[51]  M. Deutsch Trust and suspicion , 1958 .

[52]  Alex Mintz,et al.  Foreign Policy Decision Making in Familiar and Unfamiliar Settings , 2004 .

[53]  A Rapoport,et al.  Sex differences in factors contributing to the level of cooperation in the prisoner's dilemma game. , 1965, Journal of personality and social psychology.

[54]  Nehemia Geva,et al.  The Effect of Dynamic and Static Choice Sets on Political Decision Making: An Analysis Using the Decision Board Platform , 1997, American Political Science Review.

[55]  D. Campbell,et al.  Unobtrusive Measures: Nonreactive Research in the Social Sciences , 1966 .

[56]  R. Riolo,et al.  Evolution of cooperation without reciprocity , 2001, Nature.

[57]  Daniel Druckman,et al.  Determinants of Resolving a Conflict of Interest , 1973 .

[58]  D. Tjosvold,et al.  Can Chinese Discuss Conflicts Openly? Field and Experimental Studies of Face Dynamics in China , 2004 .

[59]  N. Geva,et al.  The Cognitive Calculus of Foreign Policy Decision Making , 2000 .

[60]  P. Carnevale,et al.  Laboratory Experiments on Negotiation and Social Conflict , 2005 .

[61]  David L. Rousseau,et al.  The Emergence of a Shared Identity , 2005 .

[62]  William A. Boettcher Military Intervention Decisions Regarding Humanitarian Crises , 2004 .

[63]  A. M. Schreiber,et al.  Caught Telling the Truth: Effects of Honesty and Communication Media in Distributive Negotiations , 2003 .

[64]  Daniel Druckman,et al.  Value Differences and Conflict Resolution , 1988 .

[65]  D. Mandel Economic Transactions among Friends , 2006 .

[66]  Thomas R. Palfrey,et al.  Testing for effects of cheap talk in a public goods game with private information , 1991 .

[67]  S. Walker Back to the Future? Behavioral IR as a Case of Arrested Development , 2007 .

[68]  Andreas Stiehler,et al.  A Comparison of Punishment Rules in Repeated Public Good Games , 2003 .

[69]  D. Druckman The influence of the situation in interparty conflict , 1971 .

[70]  P. James Behavioral IR: Practical Suggestions , 2007 .

[71]  S. Majeski Asymmetric Power Among Agents and the Generation and Maintenance of Cooperation in International Relations , 2004 .

[72]  Erling Moxnes,et al.  The Effect of Leadership in a Public Bad Experiment , 2003 .

[73]  Rick K. Wilson,et al.  Confusion or fairness in the field? Rejections in the ultimatum game under the strategy method , 2006 .

[74]  Michael Tomz Domestic Audience Costs in International Relations: An Experimental Approach , 2007, International Organization.

[75]  J. Andreoni Cooperation in Public-Goods Experiments: Kindness or Confusion? , 1995 .

[76]  Sarit Kraus,et al.  The Hostage Crisis Simulation , 1992 .

[77]  Ross A Hammond,et al.  ALTRUISM VIA KIN‐SELECTION STRATEGIES THAT RELY ON ARBITRARY TAGS WITH WHICH THEY COEVOLVE , 2004, Evolution; international journal of organic evolution.

[78]  R. Huckfeldt,et al.  Political Communication and Disagreement Among Citizens in Japan and the United States , 2001 .

[79]  C. Koopman,et al.  Framing, Uncertainty, and Hostile Communications in a Crisis Experiment , 2002 .

[80]  J. R. Alford,et al.  Accepting Authoritative Decisions: Humans as Wary Cooperators , 2004 .

[81]  Diana C. Mutz,et al.  The New Videomalaise: Effects of Televised Incivility on Political Trust , 2005, American Political Science Review.

[82]  H. Guetzkow Isolation and collaboration: a partial theory of inter-nation relations , 1957 .

[83]  J. Mueller,et al.  War, presidents, and public opinion , 1973 .

[84]  Jonathan Cowden,et al.  The effects of uncertainty and sex in a crisis simulation game , 2001 .

[85]  N. Geva,et al.  Cultural Similarity, Foreign Policy Actions, and Regime Perception: An Experimental Study of International Cues and Democratic Peace , 1999 .

[86]  S. Rosen,et al.  The Role of Hostile Communications in a Crisis Simulation Game , 2008 .

[87]  R. Axelrod The Dissemination of Culture , 1997 .

[88]  R. McDermott EXPERIMENTAL METHODS IN POLITICAL SCIENCE , 2003 .

[89]  Arnold Vedlitz,et al.  Can We Generalize from Student Experiments to the Real World in Political Science, Military Affairs, and International Relations? , 2006 .

[90]  Alex Mintz,et al.  How Do Leaders Make Decisions? , 2004, Contributions to Conflict Management, Peace Economics and Development.

[91]  Stephen J. Majeski,et al.  Relations among nation‐states in a changing environment: A model of repeated interaction between two groups with limited information , 1994 .

[92]  Sarit Kraus,et al.  The Negotiation Training Model , 1998 .

[93]  F. Wynstra,et al.  The Effect of Dutch and German Culture on Negotiation Strategy: An Exploratory Study to Compare Innovation and Operations Contexts , 2004 .

[94]  A. Mintz Why Behavioral IR , 2007 .

[95]  P. Godwin,et al.  Group Composition, Leadersh Ip Orientation, and Decisional Outcomes , 1976 .

[96]  T. Kuhn The Structure of Scientific Revolutions. , 1964 .

[97]  Margaret G. Hermann,et al.  An Attempt to Simulate the Outbreak of World War I , 1967, American Political Science Review.

[98]  Jonathan W. Keller,et al.  Leadership Style, Decision Context, and the Poliheuristic Theory of Decision Making: An Experimental Analysis , 2008 .

[99]  Daniel N. Posner The Political Salience of Cultural Difference: Why Chewas and Tumbukas Are Allies in Zambia and Adversaries in Malawi , 2004, American Political Science Review.

[100]  Nehemia Geva,et al.  Information inconsistency and the cognitive algebra of foreign policy decision making , 1999 .

[101]  Dina A. Zinnes A Comparison of Hostile Behavior of Decision-Makers in Simulate and Historical Data , 1966, World Politics.

[102]  Jonathan Wilkenfeld,et al.  Political Science: Network Simulation in International Politics , 1993 .

[103]  Giorgio Coricelli,et al.  Partner Selection in Public Goods Experiments , 2003 .

[104]  William D. Coplin,et al.  Simulation In the Study of Politics , 1968 .

[105]  J. F. Voss,et al.  Images in International Relations: An Experimental Test of Cognitive Schemata , 1997 .

[106]  Jason Lyall,et al.  Pocket Protests: Rhetorical Coercion and the Micropolitics of Collective Action in Semiauthoritarian Regimes , 2006 .

[107]  James N. Druckman,et al.  Framing and Deliberation: How Citizens' Conversations Limit Elite Influence , 2003 .

[108]  Barbara F. Walter,et al.  Reputation Building in International Relations: An Experimental Approach , 2011 .

[109]  Benjamin J. Broome,et al.  Value Differences and Conflict Resolution , 1986 .

[110]  William A. Boettcher,et al.  Echoes of Vietnam? , 2006 .

[111]  Matthias Sutter Public Bad Prevention by Majority Voting on Redistribution – Experimental Evidence , 2002 .

[112]  Negotiating from Mars to Venus: gender in simulated international negotiations , 2003 .

[113]  Yasufumi Shibanai,et al.  Effects of Global Information Feedback on Diversity , 2001 .

[114]  J. Wilkenfeld,et al.  Mediating International Crises , 2003 .

[115]  M. Lodge,et al.  Experiments on the Automaticity of Political Beliefs and Attitudes , 2006 .

[116]  Andreas Stiehler,et al.  A Comparison of Punishment Rules in Repeated Public Good Games , 2002 .

[117]  Earl R. Babbie,et al.  The practice of social research , 1969 .

[118]  A. Rapoport,et al.  Prisoner's Dilemma , 1965 .

[119]  Andri Ioannou,et al.  Gender and Negotiation: Some Experimental Findings from an International Negotiation Simulation1 , 2009 .

[120]  Michael X Cohen,et al.  THE ROLE OF SOCIAL STRUCTURE IN THE MAINTENANCE OF COOPERATIVE REGIMES , 2001 .

[121]  Mary J. Bellman,et al.  Assessing Power in Spatial Bargaining: When Is There Advantage to Being Status-Quo Advantaged? , 2007 .

[122]  James L. Gibson,et al.  The Role of Theory in Experimental Design: Experiments Without Randomization , 2002, Political Analysis.

[123]  James N. Druckman,et al.  Political Preference Formation: Competition, Deliberation, and the (Ir)relevance of Framing Effects , 2004, American Political Science Review.

[124]  Stephen J. Majeski,et al.  Generating and maintaining cooperation in international relations: A model of repeated interaction among groups in complex and uncertain situations , 1995 .

[125]  Helen E. Purkitt,et al.  An experimental study of cognitive processes and information in political problem solving , 1988 .