It's new, but is it good? How generalization and uncertainty guide the exploration of novel options.