Early warning signals for war in the news

There have been more than 200 wars since the start of the 20th century, leading to about 35 million battle deaths. However, efforts at forecasting conflicts have so far performed poorly for lack of fine-grained and comprehensive measures of geopolitical tensions. In this article, a weekly risk index is derived by analyzing a comprehensive dataset of historical newspaper articles over the past century. News reports have the advantage of conveying information about contemporaries’ interpretation of events and not having to rely on meaning inferred a posteriori with the benefit of hindsight. I applied this new index to a dataset of all wars within and between countries recorded since 1900, and found that the number of conflict-related news items increases dramatically prior to the onset of conflict. Using only information available at the time, the onset of a war within the next few months could be predicted with up to 85% confidence and predictions significantly improved upon existing methods both in terms of binary predictions (as measured by the area under the curve) and calibration (measured by the Brier score). Predictions also extend well before the onset of war – more than one year prior to interstate wars, and six months prior to civil wars – giving policymakers significant additional warning time.

[1]  Michael D. Ward,et al.  Forecasting is difficult, especially about the future , 2013 .

[2]  Thomas Bernauer,et al.  New Event Data in Conflict Research , 2012 .

[3]  John Stuckey Capability distribution, uncertainty, and major power war, 1820–1965 (1972) (with Stuart A. Bremer and , 2012 .

[4]  Michael D. Ward,et al.  The Separation Plot: A New Visual Method for Evaluating the Fit of Binary Models , 2011 .

[5]  Kalev Leetaru,et al.  Culturomics 2.0: Forecasting large-scale human behavior using global news media tone in time and space , 2011, First Monday.

[6]  Thomas Chadefaux,et al.  Bargaining over power: when do shifts in power lead to war? , 2011, International Theory.

[7]  Nils B. Weidmann,et al.  Predicting Conflict in Space and Time , 2010 .

[8]  Kristin M. Bakke,et al.  The perils of policy by p-value: Predicting civil conflicts , 2010 .

[9]  Curtis S. Signorino,et al.  Back to the Future: Modeling Time Dependence in Binary Data , 2010, Political Analysis.

[10]  Gerald Schneider,et al.  Exploring the Past, Anticipating the Future: A Symposium , 2010 .

[11]  Sean P. O'Brien,et al.  Crisis Early Warning and Decision Support: Contemporary Approaches and Thoughts on Future Research , 2010 .

[12]  M. Sarkees,et al.  Resort to War: 1816 - 2007 , 2010 .

[13]  J. Goldstone,et al.  A Global Model for Forecasting Political Instability , 2010 .

[14]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[15]  Thomas A. Rietz,et al.  Prediction market accuracy in the long run , 2008 .

[16]  Randolph M. Siverson,et al.  Disputes, Democracies, and Dependencies: A Reexamination of the Kantian Peace , 2007 .

[17]  Nassim Nicholas Taleb,et al.  The Black Swan: The Impact of the Highly Improbable , 2007 .

[18]  W. Briggs Statistical Methods in the Atmospheric Sciences , 2007 .

[19]  Thomas Lengauer,et al.  ROCR: visualizing classifier performance in R , 2005, Bioinform..

[20]  P. Tetlock Expert Political Judgment: How Good Is It? How Can We Know? , 2005 .

[21]  Mark Craven,et al.  Markov Networks for Detecting Overalpping Elements in Sequence Data , 2004, NIPS.

[22]  Gary King,et al.  Theory and Evidence in International Conflict: A Response to de Marchi, Gelpi, and Grynaviski , 2004, American Political Science Review.

[23]  Robert Powell,et al.  The Inefficient Use of Power: Costly Conflict with Complete Information , 2004, American Political Science Review.

[24]  Faten Ghosn,et al.  The MID3 Data Set, 1993—2001: Procedures, Coding Rules, and Description , 2004 .

[25]  Gary King,et al.  An Automated Information Extraction Tool for International Conflict Data with Performance as Good as Human Coders: A Rare Events Evaluation Design , 2003, International Organization.

[26]  J. Fearon,et al.  Ethnicity, Insurgency, and Civil War , 2003, American Political Science Review.

[27]  Stanley A. Feder,et al.  FORECASTING FOR POLICY MAKING IN THE POST–COLD WAR PERIOD , 2002 .

[28]  R. Powell BARGAINING THEORY AND INTERNATIONAL CONFLICT , 2002 .

[29]  Philip A. Schrodt,et al.  Author’s Note , 2000, American Project.

[30]  Charles L. Glaser The Causes and Consequences of Arms Races , 2000 .

[31]  N. Ferguson The pity of war , 2000 .

[32]  G. King,et al.  Improving Quantitative Studies of International Conflict: A Conjecture , 2000, American Political Science Review.

[33]  James H. Lebovic Using Military Spending Data: The Complexity of Simple Inference , 1999 .

[34]  Jon C. W. Pevehouse,et al.  Serbian Compliance or Defiance in Kosovo? , 1999 .

[35]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[36]  Nathaniel Beck,et al.  Taking Time Seriously: Time-Series-Cross-Section Analysis with a Binary Dependent Variable , 1998 .

[37]  J. Ray DOES DEMOCRACY CAUSE PEACE , 1998 .

[38]  James H. Lebovic Consider the Source: Organizational Bias in Estimates of Foreign Military Spending , 1998 .

[39]  W. B. Hunt Getting to War: Predicting International Conflict with Mass Media Indicators , 1997 .

[40]  Paul K. Huth Standing Your Ground: Territorial Disputes and International Conflict , 1996 .

[41]  Jeannette Jet Lawrence,et al.  Untangling neural nets , 1990 .

[42]  W. Moul Balances of Power and the Escalation to War of Serious Disputes among the European Great Powers, 1815-1939: Some Evidence , 1988 .

[43]  Randolph M. Siverson,et al.  Power, Alliance, and the Escalation of International Conflict, 1815-1965 , 1984, American Political Science Review.

[44]  Z. Maoz,et al.  Militarized Interstate Disputes, 1816-1976 , 1984 .

[45]  E. Azar The Conflict and Peace Data Bank (COPDAB) Project , 1980 .

[46]  D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[47]  Ole R. Holsti,et al.  The Value of International Tension Measurement , 1963 .

[48]  J. Rosenau,et al.  Public Opinion and Foreign Policy: An Operational Formulation. , 1962 .

[49]  Alexander L. George,et al.  Propaganda Analysis: A Study of Inferences Made from Nazi Propaganda in World War II. , 1960 .

[50]  K. Deutsch Mass communications and the loss of freedom in national decision-making: a possible research approach to interstate conflicts , 1957 .

[51]  A. Bellamy The steps to war: An empirical study , 2010 .

[52]  W. B. Hunt Getting to War , 1997 .

[53]  Philip A. Schrodt,et al.  Using Cluster Analysis to Derive Early Warning Indicators for Political Change in the Middle East, 1979-1996 , 1996 .

[54]  Ole R. Holsti,et al.  Public opinion and American foreign policy , 1996 .

[55]  Paul K. Huth Standing Your Ground , 1996 .

[56]  C. McClelland World event/interaction survey , 1978 .

[57]  Nora S. Newcombe,et al.  The development of an inter‐nation tensiometer , 1974 .

[58]  Nazli Choucri,et al.  Forecasting in international relations: Problems and prospects , 1974 .

[59]  Bruce Russett,et al.  Peace, war, and numbers , 1972 .

[60]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[61]  H. Lasswell Propaganda technique in the world war , 1938 .