Conclusion: Research Transparency for a Diverse Discipline

The contributors to this symposium offer important reflections and insights on what research transparency can and should mean for political scientists. In offering these insights, they have drawn on their experience and expertise in a broad range of research traditions that prominently involve one or more “qualitative” methods for gathering or analyzing empirical information. The issues discussed in this symposium, however, are just as important for scholars in research traditions that use primarily or exclusively “quantitative” analytical methods and pre-existing datasets, as we will discuss below. Rather than simply summarize the many important points that each contributor has made, we seek in this concluding essay to map out the conversation that has unfolded in these pages—in particular, to identify important areas of agreement about the meaning of transparency and to illuminate the structure and sources of key disagreements. We also reflect on broader implications of the symposium discussion for the transparency agenda in Political Science. To organize the first part of our discussion, we largely employ the APSA Ethics Guide’s distinction among production transparency (defined as providing an “account of the procedures used to collect or generate data”1), analytic transparency (defined as “clearly explicating the links connecting data to conclusion”2), and data access. These categories are closely related to matters of empirical evidence, and this will also be our primary focus below. We wish to emphasize at the outset, however, that openness in the research process is not solely a matter of how we account for and share data and data-analytic procedures. Research transparency—defined broadly as providing a full account of the sources and content of ideas and information on which a scholar

[1]  M. Fiorina Rational Choice, Empirical Contributions, and the Scientific Enterprise , 2017, The Rational Choice Controversy.

[2]  M. Humphreys,et al.  Mixing Methods: A Bayesian Approach , 2015, American Political Science Review.

[3]  Data Access and Research Transparency (DA-RT): A Joint Statement by Political Science Journal Editors , 2015, Italian Political Science Review/Rivista Italiana di Scienza Politica.

[4]  Elizabeth Wager,et al.  Retraction policies of top scientific journals ranked by impact factor. , 2015, Journal of the Medical Library Association : JMLA.

[5]  J. Isaac For a More Public Political Science , 2015, Perspectives on Politics.

[6]  Elizabeth Wager,et al.  Why are retractions so difficult , 2015 .

[7]  T. Saey Repeat Performance: Too many studies, when replicated, fail to pass muster , 2015 .

[8]  E. Saunders Transparency without Tears: A Pragmatic Approach to Transparent Security Studies Research , 2014 .

[9]  Iztok Hozo,et al.  Effect of Initial Conditions on Reproducibility of Scientific Research , 2014, Acta informatica medica : AIM : journal of the Society for Medical Informatics of Bosnia & Herzegovina : casopis Drustva za medicinsku informatiku BiH.

[10]  Colin Elman,et al.  Data Access and Research Transparency in the Qualitative Tradition , 2013, PS: Political Science & Politics.

[11]  Macartan Humphreys,et al.  Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration , 2012, Political Analysis.

[12]  Stephen S. Golub,et al.  DEFINING AND MEASURING GREEN FDI: AN EXPLORATORY REVIEW OF EXISTING WORK AND EVIDENCE , 2011 .

[13]  Walter Mattli,et al.  The New Global Rulers: The Privatization of Regulation in the World Economy , 2011 .

[14]  Adria Lawrence Triggering Nationalist Violence: Competition and Conflict in Uprisings against Colonial Rule , 2010, International Security.

[15]  A. Moravcsik,et al.  Active Citation: A Precondition for Replicable Qualitative Research , 2010, PS: Political Science & Politics.

[16]  H. Milner,et al.  Bilateral Investment Treaties and Foreign Direct Investment: A Political Analysis * , 2009 .

[17]  Richard Smith Most cases of research misconduct go undetected, conference told , 2008, BMJ : British Medical Journal.

[18]  P. Jackson Foregrounding ontology: dualism, monism, and IR theory , 2008, Review of International Studies.

[19]  Claire Lauterbach The Costs of Cooperation: Civilian Casualty Counts in Iraq , 2007 .

[20]  Yoshiko M. Herrera,et al.  Improving Data Quality: Actors, Incentives, and Capabilities , 2007, Political Analysis.

[21]  Jules Townshend,et al.  Power, A Radical View , 2007 .

[22]  S. Huffmon Expert Political Judgment: How Good Is It? How Can We Know? , 2006 .

[23]  Keith E. Maskus,et al.  The Cost of Compliance with Product Standards for Firms in Developing Countries: An Econometric Study , 2005 .

[24]  R. Putnam APSA Presidential Address: The Public Role of Political Science , 2003, Perspectives on Politics.

[25]  J. Fearon,et al.  Ethnicity, Insurgency, and Civil War , 2003, American Political Science Review.

[26]  Tim Büthe,et al.  Taking Temporality Seriously: Modeling History and the Use of Narratives as Evidence , 2002, American Political Science Review.

[27]  D. Collier,et al.  Measurement Validity: A Shared Standard for Qualitative and Quantitative Research , 2001, American Political Science Review.

[28]  S. Henson,et al.  Barriers to Agricultural Exports from Developing Countries: The Role of Sanitary and Phytosanitary Requirements , 2001 .

[29]  Kenneth A. Bollen,et al.  Subjective Measures of Liberal Democracy , 2000 .

[30]  C. Bellak The measurement of foreign direct investment: A critical review , 1998 .

[31]  P. Sniderman Evaluation Standards for a Slow-Moving Science , 1995, PS.

[32]  Gary King Replication, Replication , 1995, PS: Political Science & Politics.

[33]  Ronald L. Rogowski The Role of Theory and Anomaly in Social-Scientific Inference , 1995, American Political Science Review.

[34]  Joseph Farrell,et al.  Choosing How to Compete: Strategies and Tactics in Standardization , 1994 .

[35]  W. B. Gallie Essentially Contested Concepts , 1994, The Importance of Language.

[36]  Richard F. Fenno Observation, Context, and Sequence in the Study of Politics , 1986, American Political Science Review.

[37]  David A. Baldwin,et al.  The Power of Positive Sanctions , 1971, World Politics.

[38]  Margaret E. Roberts,et al.  Transparency Standards in Qualitative Comparative Analysis , 2017 .

[39]  Victor C. Shih Research in Authoritarian Regimes: Transparency Tradeoffs and Solutions , 2017 .

[40]  C. Peirce An unpublished manuscript) , 2016 .

[41]  Paul Pierson,et al.  Historical Institutionalism in Contemporary Political Science , 2002 .

[42]  G. Morgan,et al.  Measurement validity. , 2001, Journal of the American Academy of Child and Adolescent Psychiatry.

[43]  C. Shapiro,et al.  Network Externalities, Competition, and Compatibility , 1985 .

[44]  Jack Snyder The Ideology of the Offensive: Military Decision Making and the Disasters of 1914 , 1984 .

[45]  Committee on Professional Ethics, Rights and Freedoms , 1981, PS: Political Science & Politics.

[46]  R. Jervis Perception and misperception in international politics , 1976 .