Control and game-theoretic models of the environment