A menu of designs for reinforcement learning over time