Unifying offline and online simulation for online decision-making