Choosing between heuristics and strategies: an enhanced model for decision-making

Often an agent that has to solve a problem must choose which heuristic or strategy will help it the most in achieving its objectives. Sometimes the agent wishes to obtain additional units of information on the possible heuristics and strategies in order to choose between them, but it may be costly. As a result, the agent's goal is to acquire enough units of information in order to make a decision while incurring minimal cost. We focus on situations where the agent must decide in advance how many units it would like to obtain. We present an algorithm for choosing between two options, and then formulate three methods for the general case where there are k > 2 options to choose from. We investigate the 2-option algorithm and the general k-option methods effectiveness in two domains: the 3-SAT domain, and the CT computer game. In both domains we present the experimental performance of our models. Results will show that applying the 2-option algorithm is beneficial and provides the agent a substantial gain. In addition, applying the k-option method in the domains investigated results in a moderate gain.

[1]  Rina Azoulay-Schwartz,et al.  Acquiring an Optimal Amount of Information for Choosing from Alternatives , 2002, CIA.

[2]  Bart Selman,et al.  Local search strategies for satisfiability testing , 1993, Cliques, Coloring, and Satisfiability.

[3]  Christian M. Ernst,et al.  Multi-armed Bandit Allocation Indices , 1989 .

[4]  Ya'akov Gal,et al.  Adapting to agents' personalities in negotiation , 2005, AAMAS '05.

[5]  Sarit Kraus,et al.  The influence of social dependencies on decision-making: initial investigations with a new game , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[6]  Shlomo Zilberstein,et al.  A Value-Driven System for Autonomous Information Gathering , 2004, Journal of Intelligent Information Systems.

[7]  Piotr J. Gmytrasiewicz,et al.  Time sensitive sequential myopic information gathering , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[8]  Elisa Guerrero Vázquez,et al.  A statistical model selection strategy applied to neural networks , 2000, ESANN.

[9]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .

[10]  Bengt Carlsson,et al.  Generous and greedy strategies , 1999 .