Decision Making with Imperfect Knowledge of the State Space