How to Use Limited Memory in Heuristic Search

Traditional best-first search for optimal solutions quickly runs out of space even for problem instances of moderate size, and linear-space search has unnecessarily long running times since it cannot make use of available memory. For using available memory effectively, we developed a new generic approach to heuristie search. It integrates various strategies and includes ideas from bidirectional search. Due to insights into different utilizations of available memory, it allows the search to use limited memory effectively. Instantiations of this approach for two different benchmark domains showed excellent results that are statistically significant improvements over previously reported results: for finding optimal solutions in the 15-Puzzle we achieved the fastest searches of all those using the Manhattan distance heuristic as the only knowledge source, and for a scheduling domain our approach can solve much more difficult problems than the best competitor. The most important lessons we learned from the experiments are first, that also in domains with symmetric graph topology selecting the right search direction can be very important, and second, that memory can-- under certain conditions--be used much more effectively than by traditional best-first search.

[1]  Dennis de Champeaux,et al.  Bidirectional Heuristic Search Again , 1983, JACM.

[2]  Richard E. Korf,et al.  Depth-First vs. Best-First Search: New Results , 1993, AAAI.

[3]  P. P. Chakrabarti,et al.  Heuristic Search in Restricted Memory , 1989, Artif. Intell..

[4]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Richard E. Korf,et al.  Depth-first vs best-first search , 1991 .

[6]  F. R. A. Hopgood,et al.  Machine Intelligence 6 , 1972, The Mathematical Gazette.

[7]  Richard E. Korf,et al.  Pruning Duplicate Nodes in Depth-First Search , 1993, AAAI.

[8]  Richard E. Korf,et al.  Depth-First Iterative-Deepening: An Optimal Admissible Tree Search , 1985, Artif. Intell..

[9]  Rina Dechter,et al.  Generalized best-first search strategies and the optimality of A* , 1985, JACM.

[10]  Stuart J. Russell Efficient Memory-Bounded Search Methods , 1992, ECAI.

[11]  James B. H. Kwa,et al.  BS*: An Admissible Bidirectional Staged Heuristic Search Algorithm , 1989, Artif. Intell..

[12]  Alexander Reinefeld,et al.  Enhanced Iterative-Deepening Search , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Richard E. Korf,et al.  Linear-Space Best-First Search , 1993, Artif. Intell..

[14]  Peter C. Nelson,et al.  Perimeter Search , 1994, Artif. Intell..

[15]  Anup K. Sen,et al.  Job sequencing with quadratic penalties: An A*-based graph search approach , 1993, Proceedings of 9th IEEE Conference on Artificial Intelligence for Applications.

[16]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[17]  E. L. Lawler,et al.  Branch-and-Bound Methods: A Survey , 1966, Oper. Res..

[18]  Dana S. Nau,et al.  ITS: An Efficient Limited-Memory Heuristic Tree Search Algorithm , 1994, AAAI.

[19]  W. Townsend The Single Machine Problem with Quadratic Penalty Function of Completion Times: A Branch-and-Bound Solution , 1978 .

[20]  Hermann Kaindl,et al.  Improvements on Linear-Space Search Algorithms , 1994, ECAI.

[21]  Hermann Kaindl,et al.  Memory-Bounded Bidirectional Search , 1994, AAAI.

[22]  Amitava Bagchi,et al.  Fast Recursive Formulations for Best-First Search That Allow Controlled Use of Memory , 1989, IJCAI.

[23]  Hermann Kaindl,et al.  Bidirectional Best-First Search with Bounded Error: Summary of Results , 1993, IJCAI.