On the learning patterns and adaptive behavior of terrorist organizations

Abstract The threat to national security posed by terrorists makes the design of evidence-based counter-terrorism strategies paramount. As terrorist organizations are purposeful entities, it is crucial to understand their decision processes if we want to plan defenses and counter-measures. In particular, there is evidence that terrorist organizations are both adaptive in their behavior and driven by multiple objectives in their actions. In this paper, we use insights from learning theory and compare several different reinforcement learning models regarding their ability to predict terrorist organizations’ actions. Using data on target choices of terrorist attacks and two different objectives (renown and revenge), we show that a total reinforcement learning with power (Luce) choice probabilities and information discounting can be used to model the adaptive behavior of terrorist organizations. The model renders out-of-sample predictions which are comparable in their validity to those observed for learning in laboratory studies. We draw implications for counter-terrorism strategies by comparing the predictive validity of the different models and their calibrated parameters. Our results also offer a starting point for studying the convergence process in game theoretic analyses of conflicts involving terrorists.

[1]  Edward H. Kaplan,et al.  Terror Queues , 2010, Oper. Res..

[2]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[3]  Kai A. Konrad The Investment Problem in Terrorism , 2004 .

[4]  E. Thorndike “Animal Intelligence” , 1898, Nature.

[5]  Raimo P. Hämäläinen,et al.  Behavioural operational research: Returning to the roots of the OR profession , 2016, Eur. J. Oper. Res..

[6]  Kjell Hausken,et al.  A cost–benefit analysis of terrorist attacks , 2018 .

[7]  Johannes G. Jaspersen,et al.  Experiential Learning, Competitive Selection, and Downside Risk: A New Perspective on Managerial Risk Taking , 2017, Organ. Sci..

[8]  M. Rabin,et al.  A Model of Reference-Dependent Preferences , 2006 .

[9]  R. Selten Axiomatic Characterization of the Quadratic Scoring Rule , 1998 .

[10]  Kjell Hausken,et al.  Endogenizing the sticks and carrots: modeling possible perverse effects of counterterrorism measures , 2011, Ann. Oper. Res..

[11]  H. Greve Performance, Aspirations, and Risky Organizational Change , 1998 .

[12]  Theresa K. Lant,et al.  Aspiration Level Adaptation: An Empirical Exploration , 1992 .

[13]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[14]  Rachel Q. Zhang,et al.  The Reference Effects on a Retailer's Dynamic Pricing and Inventory Strategies with Strategic Consumers , 2015, Oper. Res..

[15]  Konstantinos V. Katsikopoulos,et al.  On the role of psychological heuristics in operational research; and a demonstration in military stability operations , 2016, Eur. J. Oper. Res..

[16]  Robert Powell,et al.  Allocating Defensive Resources with Private Information about Vulnerability , 2007, American Political Science Review.

[17]  N. Johnson,et al.  Common ecology quantifies human insurgency , 2009, Nature.

[18]  G. Montibeller,et al.  In the Opponent's Shoes: Increasing the Behavioral Validity of Attackers’ Judgments in Counterterrorism Models , 2016, Risk analysis : an official publication of the Society for Risk Analysis.

[19]  Edward H. Kaplan,et al.  OR Forum - Intelligence Operations Research: The 2010 Philip McCord Morse Lecture , 2012, Oper. Res..

[20]  Charles Sprenger,et al.  An Endowment Effect for Risk: Experimental Tests of Stochastic Reference Points , 2015, Journal of Political Economy.

[21]  Daniel Friedman,et al.  Individual Learning in Normal Form Games: Some Laboratory Results☆☆☆ , 1997 .

[22]  Dilip Mookherjee,et al.  Learning and Decision Costs in Experimental Constant Sum Games , 1997 .

[23]  K. Hausken,et al.  Behaviorist stochastic modeling of instrumental learning , 2001, Behavioural Processes.

[24]  Sarit Kraus,et al.  Deployed ARMOR protection: the application of a game theoretic model for security at the Los Angeles International Airport , 2008, AAMAS 2008.

[25]  Steve Alpern,et al.  Patrolling Games , 2011, Oper. Res..

[26]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[27]  Andreas Ramos,et al.  Search Engine Marketing , 2008 .

[28]  L. J. Savage,et al.  The Utility Analysis of Choices Involving Risk , 1948, Journal of Political Economy.

[29]  Edward H. Kaplan,et al.  Analysis of a Strategic Terror Organization , 2010 .

[30]  Gilberto Montibeller,et al.  Modeling State-Dependent Priorities of Malicious Agents , 2012, Decis. Anal..

[31]  E. Thorndike The law of effect. , 1927 .

[32]  J. March,et al.  A Behavioral Theory of the Firm , 1964 .

[33]  Vicki M. Bier,et al.  Balancing Terrorism and Natural Disasters - Defensive Strategy with Endogenous Attacker Effort , 2007, Oper. Res..

[34]  Tilman Börgers,et al.  Naive Reinforcement Learning With Endogenous Aspirations , 2000 .

[35]  David Gill,et al.  Cognitive Ability, Character Skills, and Learning to Play Equilibrium: A Level-k Analysis , 2014, Journal of Political Economy.

[36]  Colin Camerer,et al.  Experience‐weighted Attraction Learning in Normal Form Games , 1999 .

[37]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[38]  Konstantinos V. Katsikopoulos,et al.  Bounded rationality: the two cultures , 2014 .

[39]  Paan Jindapon,et al.  Network Externalities and the Structure of Terror Networks , 2010 .

[40]  B. Caplan Terrorism: The relevance of the rational choice model , 2006 .

[41]  Jerker Denrell,et al.  Organizational risk taking: adaptation versus variable risk preferences , 2008 .

[42]  Richard S. John,et al.  Identifying and Structuring the Objectives of the Islamic State of Iraq and the Levant (ISIL) and Its Followers , 2016, Decis. Anal..

[43]  Victor Asal,et al.  The Nature of the Beast: Organizational Structures and the Lethality of Terrorist Attacks , 2008, The Journal of Politics.

[44]  Ioana Popescu,et al.  Dynamic Pricing Strategies with Reference Effects , 2007, Oper. Res..

[45]  Alan W. Beggs,et al.  On the convergence of reinforcement learning , 2005, J. Econ. Theory.

[46]  Brian Tivnan,et al.  Pattern in Escalations in Insurgent and Terrorist Activity , 2011, Science.

[47]  Eli Berman,et al.  Religion, Terrorism and Public Goods: Testing the Club Model , 2008 .

[48]  P. Neumann Radicalized: New Jihadists and the Threat to the West , 2016 .

[49]  S. Atran Genesis of Suicide Terrorism , 2003, Science.

[50]  K. Peren Arin,et al.  Exploring the dynamics between terrorism and anti-terror spending: Theory and UK-evidence , 2011 .

[51]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[52]  Martin Weber,et al.  Reference-Point Formation and Updating , 2011, Manag. Sci..

[53]  Roberto Szechtman,et al.  Why Defeating Insurgencies Is Hard: The Effect of Intelligence in Counterinsurgency Operations - A Best-Case Scenario , 2009, Oper. Res..

[54]  Susan Maret,et al.  Global Terrorism Database , 2018 .

[55]  Kent D. Miller,et al.  Variable Organizational Risk Preferences: Tests of the March-Shapira Model , 2004 .

[56]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[57]  Daniel A. Levinthal,et al.  Learning from Experience in Organizations , 1985 .

[58]  J. Cross A Stochastic Learning Model of Economic Behavior , 1973 .

[59]  Todd Sandler,et al.  Terrorist attack and target diversity , 2013 .

[60]  Stefan Wrzaczek,et al.  Optimal control of a terror queue , 2016, Eur. J. Oper. Res..

[61]  H. Stott Cumulative prospect theory's functional menagerie , 2006 .