Real-Time Search in Dynamic Worlds

For problems such as pathfinding in video games and robotics, a search algorithm must be real-time (return the next move within a fixed time bound) and dynamic (accommodate edge costs that can increase and decrease before the goal is reached). Existing real-time search algorithms, such as LSS-LRTA*, can handle edge cost increases but do not handle edge cost decreases. Existing dynamic search algorithms, such as D* Lite, are not real-time. We show how these two families of algorithms can be combined using bidirectional search, producing Real-Time D* (RTD*), the first real-time search algorithm designed for dynamic worlds. Our empirical evaluation shows that, for dynamic grid pathfinding, RTD* results in significantly shorter trajectories than either LSS-LRTA* or naive real-time adaptations of D* Lite because of its ability to opportunistically exploit shortcuts.

[1]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[2]  Sven Koenig,et al.  Generalized Adaptive A* , 2008, AAMAS.

[3]  Jonathan Schaeffer,et al.  Dynamic Control in Real-Time Heuristic Search , 2008, J. Artif. Intell. Res..

[4]  Sebastian Thrun,et al.  Anytime Dynamic A*: An Anytime, Replanning Algorithm , 2005, ICAPS.

[5]  Sven Koenig,et al.  Comparing real-time and incremental heuristic search for real-time situated agents , 2009, Autonomous Agents and Multi-Agent Systems.

[6]  Richard E. Korf,et al.  Real-Time Heuristic Search , 1990, Artif. Intell..

[7]  Maxim Likhachev,et al.  D*lite , 2002, AAAI/IAAI.

[8]  David Furcy,et al.  Lifelong Planning A , 2004, Artif. Intell..

[9]  Nathan R. Sturtevant,et al.  TBA*: Time-Bounded A* , 2009, IJCAI.