Taxonomy and Method for Handling Large and Diverse Sets of Interactive Objects in Immersive Environments

The growing interest in immersive 3D environments populated with intelligent agents has led to a flurry of approaches and products with particular focuses, including cultural awareness training, language training, and operations “what-if” scenarios. Human terrain data present challenges that require categorization efforts. We present a taxonomy and approach to handle physical structures realistic intelligent agents and players interact with, manipulate, and discuss. A short interaction with an explainable, socio-cognitive agent in a prototype cultural awareness training game called NonKin Village is reviewed and we outline next steps as well opportunities for research, collaboration, and standards development.