Predicting Human Decision-Making: From Prediction to Action

Abstract Human decision-making often transcends our formal models of "rationality." Designing intelligent agents that interact proficiently with people necessitates the modeling of human behavior and the prediction of their decisions. In this book, we explore the task of automatically predicting human decision-making and its use in designing intelligent human-aware automated computer systems of varying natures—from purely conflicting interaction settings (e.g., security and games) to fully cooperative interaction settings (e.g., autonomous driving and personal robotic assistants). We explore the techniques, algorithms, and empirical methodologies for meeting the challenges that arise from the above tasks and illustrate major benefits from the use of these computational solutions in real-world application domains such as security, negotiations, argumentative interactions, voting systems, autonomous driving, and games. The book presents both the traditional and classical methods as well as the most recent a...

[1]  Colin Camerer,et al.  A Cognitive Hierarchy Model of Games , 2004 .

[2]  H. Bleichrodt,et al.  Do financial professionals behave according to prospect theory? An experimental study , 2013 .

[3]  Sarit Kraus,et al.  Psychologically Based Virtual-Suspect for Interrogative Interview Training , 2016, IVA.

[4]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[5]  Hillary Anger Elfenbein,et al.  What Do People Value When They Negotiate? Mapping the Domain of Subjective Value in Negotiation , 2006, Journal of personality and social psychology.

[6]  Alessio Malizia,et al.  A First Approach to Understanding and Measuring Naturalness in Driver-Car Interaction , 2014, AutomotiveUI.

[7]  Schneider,et al.  All Frames Are Not Created Equal: A Typology and Critical Analysis of Framing Effects. , 1998, Organizational behavior and human decision processes.

[8]  Antonio Torralba,et al.  Anticipating Visual Representations from Unlabeled Video , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  V. Smith,et al.  Reciprocity in Ultimatum and Dictator Games: An Introduction , 2008 .

[10]  Jonathan Schaeffer,et al.  Checkers Is Solved , 2007, Science.

[11]  Sarit Kraus,et al.  An adversarial environment model for bounded rational agents in zero-sum interactions , 2007, AAMAS '07.

[12]  José María Valls,et al.  Programming Robosoccer agents by modeling human behavior , 2009, Expert Syst. Appl..

[13]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[14]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[15]  Amos Azaria,et al.  Combining psychological models with machine learning to better predict people’s decisions , 2012, Synthese.

[16]  Eric J. Johnson,et al.  The Construction of Preference: Do Defaults Save Lives? , 2006 .

[17]  Milind Tambe,et al.  Comparing human behavior models in repeated Stackelberg security games: An extended study , 2016, Artif. Intell..

[18]  Anna Bassi,et al.  Voting systems and strategic manipulation: An experimental study , 2015 .

[19]  Andrew M. Parker,et al.  Individual differences in adult decision-making competence. , 2007, Journal of personality and social psychology.

[20]  R. Selten,et al.  Aspiration Adaptation Theory. , 1998, Journal of mathematical psychology.

[21]  Barbara J. Grosz,et al.  What Question Would Turing Pose Today? , 2012, AI Mag..

[22]  Satrajit S. Ghosh,et al.  Prediction as a Humanitarian and Pragmatic Contribution from Human Cognitive Neuroscience , 2015, Neuron.

[23]  John Fox,et al.  Argumentation-Based Inference and Decision Making--A Medical Perspective , 2007, IEEE Intelligent Systems.

[24]  Marcello Guarini,et al.  Particularism and the Classification and Reclassification of Moral Cases , 2006, IEEE Intelligent Systems.

[25]  Amos Azaria,et al.  Behavioral Analysis of Insider Threat: A Survey and Bootstrapped Prediction in Imbalanced Data , 2014, IEEE Transactions on Computational Social Systems.

[26]  Henry H. Rueter,et al.  Extracting expertise from experts: Methods for knowledge acquisition , 1987 .

[27]  H. Christensen,et al.  Detecting suicidality on Twitter , 2015 .

[28]  Michael C. Herron,et al.  Did Ralph Nader Spoil Al Gore's Presidential Bid? A Ballot-Level Study of Green and Reform Party Voters in the 2000 Presidential Election , 2007 .

[29]  Philip Hingston,et al.  A Turing Test for Computer Game Bots , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[30]  Ya'akov Gal,et al.  Human-computer negotiation in a three player market setting , 2017, Artif. Intell..

[31]  Moshe Tennenholtz,et al.  Psychological Forest: Predicting Human Behavior , 2016, AAAI.

[32]  Kokolo Ikeda,et al.  Survey of How Human Players Divert In-game Actions for Other Purposes: Towards Human-Like Computer Players , 2017, ICEC.

[33]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[34]  R. Nagel Unraveling in Guessing Games: An Experimental Study , 1995 .

[35]  Bo An,et al.  PAWS - A Deployed Game-Theoretic Application to Combat Poaching , 2017, AI Mag..

[36]  Jean-François Bonnefon,et al.  A theory of utility conditionals: Paralogical reasoning from decision-theoretic leakage. , 2009, Psychological review.

[37]  Pasquale Lops,et al.  Human Decision Making and Recommender Systems , 2013, TIIS.

[38]  Katia Sycara,et al.  Multi-Agent Meeting Scheduling: Preliminary Experimental Results , 1996 .

[39]  M. Tomasello,et al.  Great apes anticipate that other individuals will act according to false beliefs , 2016, Science.

[40]  Claudio Bartolini,et al.  AutONA: a system for automated multiple 1-1 negotiation , 2003, EEE International Conference on E-Commerce, 2003. CEC 2003..

[41]  Svetlana Obraztsova,et al.  Haste makes waste: a case to favour voting bots , 2017, WI.

[42]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[43]  D. Stahl,et al.  Experimental evidence on players' models of other players , 1994 .

[44]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[45]  Arieh Gavious,et al.  Incentives' Effect in Influenza Vaccination Policy , 2013, Manag. Sci..

[46]  Mara Hvistendahl Can ‘predictive policing’ prevent crime before it happens? , 2016 .

[47]  I. Erev,et al.  From Anomalies to Forecasts: Toward a Descriptive Model of Decisions Under Risk, Under Ambiguity, and From Experience , 2017, Psychological review.

[48]  Jake Carlson,et al.  Using data management plans to explore variability in research data management practices across domains , 2016, Int. J. Digit. Curation.

[49]  Carlos Ramos,et al.  Personality, Emotion, and Mood in Agent-Based Group Decision Making , 2011, IEEE Intelligent Systems.

[50]  W. Newsome,et al.  A general mechanism for decision-making in the human brain? , 2005, Trends in Cognitive Sciences.

[51]  H. Oosterbeek,et al.  Cultural Differences in Ultimatum Game Experiments: Evidence from a Meta-Analysis , 2001 .

[52]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[53]  A. Rubinstein,et al.  The 11-20 Money Request Game: A Level-k Reasoning Study , 2012 .

[54]  Cristian Danescu-Niculescu-Mizil,et al.  Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussions , 2016, WWW.

[55]  Amos Azaria,et al.  Advice Provision for Energy Saving in Automobile Climate-Control System , 2015, AI Mag..

[56]  Julian Togelius,et al.  Ieee Transactions on Computational Intelligence and Ai in Games the 2014 General Video Game Playing Competition , 2022 .

[57]  R. McKelvey,et al.  An experimental study of the centipede game , 1992 .

[58]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[59]  Moshe Tennenholtz,et al.  Learning in One-Shot Strategic Form Games , 2006, ECML.

[60]  Philip Hingston The 2K BotPrize , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[61]  Michel Regenwetter,et al.  Approval voting and positional voting methods: Inference, relationship, examples , 2004, Soc. Choice Welf..

[62]  D. Kahneman A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[63]  David Carmel,et al.  Opponent Modeling in Multi-Agent Systems , 1995, Adaption and Learning in Multi-Agent Systems.

[64]  L. Samuelson Economic Theory and Experimental Economics , 2005 .

[65]  Ya'akov Gal,et al.  An Adaptive Agent for Negotiating with People in Different Cultures , 2011, TIST.

[66]  David R. Traum,et al.  Fight, Flight, or Negotiate: Believable Strategies for Conversing Under Crisis , 2005, IVA.

[67]  Colin Fyfe,et al.  Improving Artificial Intelligence In a Motocross Game , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[68]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[69]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[70]  Joan Y. Chiao,et al.  The cultural contagion of conflict , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[71]  Catholijn M. Jonker,et al.  An agent architecture for multi-attribute negotiation using incomplete preference information , 2007, Autonomous Agents and Multi-Agent Systems.

[72]  Manish Jain,et al.  Keeping Pace with Criminals: An Extended Study of Designing Patrol Allocation against Adaptive Opportunistic Criminals , 2016, Games.

[73]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[74]  Koen V. Hindriks,et al.  Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques , 2016, Autonomous Agents and Multi-Agent Systems.

[75]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[76]  W. Güth,et al.  An experimental analysis of ultimatum bargaining , 1982 .

[77]  Milind Tambe,et al.  Security and Game Theory: IRIS – A Tool for Strategic Security Allocation in Transportation Networks , 2011, AAMAS 2011.

[78]  H. Abdullah,et al.  Robotic assistants in personal care: A scoping review. , 2017, Medical engineering & physics.

[79]  Noa Agmon,et al.  Intelligent agent supporting human-multi-robot team collaboration , 2015, Artif. Intell..

[80]  Hema Swetha Koppula,et al.  Anticipating Human Activities Using Object Affordances for Reactive Robotic Response , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Sarit Kraus,et al.  Deployed ARMOR protection: the application of a game theoretic model for security at the Los Angeles International Airport , 2008, AAMAS 2008.

[82]  Niels Pinkwart,et al.  Computer-Supported Collaborative Learning DOI 10.1007/s11412-009-9080-x Computer-supported argumentation: A review of the state of the art , 2009 .

[83]  Elizabeth Gibney How rival bots battled their way to poker supremacy , 2017, Nature.

[84]  James A. Landay,et al.  The design of eco-feedback technology , 2010, CHI.

[85]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[86]  Bilge Mutlu,et al.  Designing persuasive robots: How robots might persuade people using vocal and nonverbal cues , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[87]  Julian Togelius,et al.  The Mario AI Benchmark and Competitions , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[88]  Jianxiong Xiao,et al.  DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[89]  Julian Togelius,et al.  Artificial and Computational Intelligence in Games: Integration (Dagstuhl Seminar 15051) , 2015, Dagstuhl Reports.

[90]  R. Hertwig,et al.  The Evolution of Generosity in the Ultimatum Game , 2016, Scientific Reports.

[91]  Alvin E. Roth,et al.  Predictive value and the usefulness of game theoretic models , 2002 .

[92]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[93]  Kevin Waugh,et al.  DeepStack: Expert-level artificial intelligence in heads-up no-limit poker , 2017, Science.

[94]  Julian Togelius,et al.  The turing test track of the 2012 Mario AI Championship: Entries and evaluation , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[95]  David Sarne,et al.  Enhancing comparison shopping agents through ordering and gradual information disclosure , 2017, Autonomous Agents and Multi-Agent Systems.

[96]  Robert L. Slonim,et al.  Combining a Theoretical Prediction with Experimental Evidence , 2002 .

[97]  Wenyan Hu,et al.  Online auctions efficiency: a survey of ebay auctions , 2008, WWW.

[98]  Dimitris Gritzalis,et al.  An Insider Threat Prediction Model , 2010, TrustBus.

[99]  Jean-François Laslier,et al.  The Leader Rule , 2009 .

[100]  V. S. Subrahmanian,et al.  APE: A Data-Driven, Behavioral Model-Based Anti-Poaching Engine , 2015, IEEE Transactions on Computational Social Systems.

[101]  Douglas Walton,et al.  Argumentation Theory: A Very Short Introduction , 2009, Argumentation in Artificial Intelligence.

[102]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[103]  Simon Parsons,et al.  Expected utility or prospect theory: Which better fits agent-based modeling of markets? , 2016, J. Comput. Sci..

[104]  R. Selten Reexamination of the perfectness concept for equilibrium points in extensive games , 1975, Classics in Game Theory.

[105]  Thomas A. Rietz,et al.  An experimental study of voting rules and polls in three-candidate elections , 1996 .

[106]  A. Gibbard Manipulation of Voting Schemes: A General Result , 1973 .

[107]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[108]  Ya'akov Gal,et al.  Training with automated agents improves people's behavior in negotiation and coordination tasks , 2014, Decis. Support Syst..

[109]  A. Rubinstein The Electronic Mail Game: Strategic Behavior Under "Almost Common Knowledge" , 1989 .

[110]  M. Bacharach Interactive team reasoning: A contribution to the theory of co-operation , 1999 .

[111]  Yang Gao,et al.  End-to-End Learning of Driving Models from Large-Scale Video Datasets , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[112]  M. Bacharach,et al.  PAYOFF DOMINANCE AND THE STACKELBERG HEURISTIC , 1997 .

[113]  Nanning Zheng,et al.  Cognitive Cars: A New Frontier for ADAS Research , 2012, IEEE Transactions on Intelligent Transportation Systems.

[114]  Ya'akov Gal,et al.  A study of computational and human strategies in revelation games , 2014, Autonomous Agents and Multi-Agent Systems.

[115]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[116]  Murray Campbell,et al.  Deep Blue , 2002, Artif. Intell..

[117]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[118]  Murray Campbell,et al.  Knowledge discovery in deep blue , 1999, Commun. ACM.

[119]  Patrick Lin Why Ethics Matters for Autonomous Cars , 2016 .

[120]  Laurie R Santos,et al.  The evolutionary roots of human decision making. , 2015, Annual review of psychology.

[121]  Avi Rosenfeld,et al.  NegoChat-A: a chat-based negotiation agent with bounded rationality , 2015, Autonomous Agents and Multi-Agent Systems.

[122]  Iyad Rahwan,et al.  The social dilemma of autonomous vehicles , 2015, Science.

[123]  David Gill,et al.  Cognitive Ability and Learning to Play Equilibrium: A Level- k Analysis , 2012 .

[124]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[125]  Yamir Moreno,et al.  Cognitive Hierarchy Theory and Two-Person Games , 2016, Games.

[126]  Kenneth W. Regan,et al.  Measuring Level-K Reasoning, Satisficing, and Human Error in Game-Play Data , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[127]  G. Loewenstein Emotions in Economic Theory and Economic Behavior , 2000 .

[128]  Sarit Kraus,et al.  Using focal point learning to improve human–machine tacit coordination , 2011, Autonomous Agents and Multi-Agent Systems.

[129]  Sidney Givigi,et al.  Towards human-robot interaction: A framing effect experiment , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[130]  Sarit Kraus,et al.  Resolving crises through automated bilateral negotiations , 2008, Artif. Intell..

[131]  Jure Leskovec,et al.  Human Decisions and Machine Predictions , 2017, The quarterly journal of economics.

[132]  Kevin Waugh,et al.  DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker , 2017, ArXiv.

[133]  Michael R. Genesereth,et al.  General Game Playing: Overview of the AAAI Competition , 2005, AI Mag..

[134]  Hema Swetha Koppula,et al.  Recurrent Neural Networks for driver activity anticipation via sensory-fusion architecture , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[135]  Kevin Leyton-Brown,et al.  Beyond equilibrium: predicting human behaviour in normal form games , 2010, AAAI.

[136]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[137]  Frédéric Kaplan,et al.  Who is Afraid of the Humanoid? Investigating Cultural Differences in the Acceptance of Robots , 2004, Int. J. Humanoid Robotics.

[138]  Sarit Kraus,et al.  Providing Arguments in Discussions on the Basis of the Prediction of Human Argumentative Behavior , 2016, ACM Trans. Interact. Intell. Syst..

[139]  Nava Tintarev,et al.  Formal Arguments, Preferences, and Natural Language Interfaces to Humans: an Empirical Evaluation , 2014, ECAI.

[140]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[141]  Rosemarie Nagel,et al.  One, Two, (Three), Infinity: Newspaper and Lab Beauty-Contest Experiments , 2000 .

[142]  Christian List,et al.  Engineering Moral Agents - from Human Morality to Artificial Morality (Dagstuhl Seminar 16222) , 2016, Dagstuhl Reports.

[143]  J. Ford,et al.  Process tracing methods: Contributions, problems, and neglected research questions , 1989 .

[144]  Peter C. Fishburn,et al.  Chapter 4 Voting procedures , 2002 .

[145]  Cecilia Mascolo,et al.  Track globally, deliver locally: improving content delivery networks by tracking geographic social cascades , 2011, WWW.

[146]  David C. Parkes,et al.  Strategic Voting Behavior in Doodle Polls , 2015, CSCW.

[147]  Dirk Heylen,et al.  Open Challenges in Modelling, Analysis and Synthesis of Human Behaviour in Human–Human and Human–Machine Interactions , 2015, Cognitive Computation.

[148]  P. Johnson-Laird,et al.  Conditionals: A Theory of Meaning, Pragmatics, and Inference , 2002 .

[149]  Michael H. Bowling,et al.  The lemonade stand game competition: solving unsolvable games , 2011, SECO.

[150]  V. S. Subrahmanian,et al.  Predicting human behavior: The next frontiers , 2017, Science.

[151]  M. Satterthwaite Strategy-proofness and Arrow's conditions: Existence and correspondence theorems for voting procedures and social welfare functions , 1975 .

[152]  Ilinca Nastase,et al.  Thermal comfort models for indoor spaces and vehicles—Current capabilities and future perspectives , 2015 .

[153]  Julian Togelius,et al.  Imitating human playing styles in Super Mario Bros , 2013, Entertain. Comput..

[154]  Jacob K. Goeree,et al.  Quantal Response Equilibrium and Overbidding in Private-Value Auctions , 2002, J. Econ. Theory.

[155]  Gregory E. Kersten,et al.  Aspire: an integrated negotiation support system and software agents for e-business negotiation , 2003, Int. J. Internet Enterp. Manag..

[156]  H. Christensen,et al.  E-Health Interventions for Suicide Prevention , 2014, International journal of environmental research and public health.

[157]  A. Gelman,et al.  An Analysis of the New York City Police Department's “Stop-and-Frisk” Policy in the Context of Claims of Racial Bias , 2007 .

[158]  Cagatay Basdogan,et al.  Supporting Negotiation Behavior with Haptics-Enabled Human-Computer Interfaces , 2012, IEEE Transactions on Haptics.

[159]  Rachel K. E. Bellamy,et al.  Designing Information for Remediating Cognitive Biases in Decision-Making , 2015, CHI.

[160]  R. McKelvey,et al.  Quantal Response Equilibria for Normal Form Games , 1995 .

[161]  Miguel A. Costa-Gomes,et al.  Cognition and Behavior in Normal-Form Games: An Experimental Study , 1998 .

[162]  Amos Azaria,et al.  Strategic Information Disclosure to People with Multiple Alternatives , 2011, AAAI.

[163]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors , 2005, TCHI.

[164]  Sarit Kraus,et al.  Optimizing Traffic Enforcement: From the Lab to the Roads , 2017, GameSec.

[165]  D. Stahl,et al.  On Players' Models of Other Players: Theory and Experimental Evidence , 1995 .

[166]  Sarit Kraus,et al.  DESIGNING AND BUILDING A NEGOTIATING AUTOMATED AGENT , 1995, Comput. Intell..

[167]  Pascal Poncelet,et al.  Mining Twitter for Suicide Prevention , 2014, NLDB.

[168]  Gregory E. Kersten,et al.  Negotiation Support and E-negotiation Systems: An Overview , 2007 .

[169]  Jodi Forlizzi,et al.  Mining behavioral economics to design persuasive technology for healthy choices , 2011, CHI.

[170]  Iyad Rahwan,et al.  Behavioral Experiments for Assessing the Abstract Argumentation Semantics of Reinstatement , 2010, Cogn. Sci..

[171]  Cecilia Mascolo,et al.  A Tale of Many Cities: Universal Patterns in Human Urban Mobility , 2011, PloS one.

[172]  Jure Leskovec,et al.  Antisocial Behavior on the Web: Characterization and Detection , 2017, WWW.

[173]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[174]  Jure Leskovec,et al.  The Selective Labels Problem: Evaluating Algorithmic Predictions in the Presence of Unobservables , 2017, KDD.

[175]  Miguel A. Costa-Gomes,et al.  Structural Models of Nonequilibrium Strategic Thinking: Theory, Evidence, and Applications , 2013 .

[176]  Robert L. Winkler,et al.  The Optimizer's Curse: Skepticism and Postdecision Surprise in Decision Analysis , 2006, Manag. Sci..

[177]  Oliver Kramer,et al.  Evolution of Reactive Rules in Multi Player Computer Games Based on Imitation , 2005, ICNC.

[178]  Gerald L. Lohse,et al.  Defaults, Framing and Privacy: Why Opting In-Opting Out1 , 2002 .

[179]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[180]  J. Lisman The Challenge of Understanding the Brain: Where We Stand in 2015 , 2015, Neuron.

[181]  E. Shortliffe Clinical decision-support systems , 1990 .

[182]  T. Gärling,et al.  Weighing the past and the future in decision making , 2005 .

[183]  J. Whitlock,et al.  Young Adult Respondent Experiences of Disclosing Self-Injury, Suicide-Related Behavior, and Psychological Distress in a Web-Based Survey , 2013, Archives of suicide research : official journal of the International Academy for Suicide Research.

[184]  Joseph Weizenbaum,et al.  and Machine , 1977 .

[185]  Henry Prakken,et al.  Towards Artificial Argumentation , 2017, AI Mag..

[186]  Iyad Rahwan,et al.  Experimental Assessment of Aggregation Principles in Argumentation-Enabled Collective Intelligence , 2016, ACM Trans. Internet Techn..

[187]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[188]  Alex Fridman,et al.  What Can Be Predicted from Six Seconds of Driver Glances? , 2016, CHI.

[189]  Kevin Leyton-Brown,et al.  Level-0 meta-models for predicting human behavior in games , 2014, EC.

[190]  Sarah Callaghan,et al.  Citation and Peer Review of Data: Moving Towards Formal Data Publication , 2011, Int. J. Digit. Curation.

[191]  Oded Nov,et al.  Informing and Improving Retirement Saving Performance using Behavioral Economics Theory-driven User Interfaces , 2015, CHI.