Preliminary Thoughts on the Application of Real-Time AI Game-Tree Search to Control *

Abstract We introduce a formal definition of a general hybrid system control game, and a decision procedure for an agent which uses simulation to inform game-playing decisions in real-time. We discuss heuristics informing the estimation of expected utilities of actions, describe metalevel reasoning criteria which direct game-tree expansion according to decision relevance, and point out challenges in applying ideas from AI real-time game-tree search to control.