Modeling autonomous agents in changing environments