Explore/Exploit Strategies in Autonomy