“Situated AI” in Video Games: Integrating NLP, Path Planning and 3D Animation

This paper investigates the integration of Artificial Intelligence techniques into video games, from the perspective of voice controlled adventure games. Speech-based interfaces would add new dimensions to the control of video games. However, the integration of speech raises several issues, such as the adequate level of interpretation that should be carried by the system. We describe the implementation of a command interpreter based on Natural Language Processing techniques and specifically discuss the generation of appropriate system actions from spoken commands. The relevant AI techniques are plan generation and path planning. We consider the generation of simplified plans within the situated AI paradigm as a good candidate for integration with NLP. Work is in progress to reincorporate traditional search-based path planning into the same paradigm.