Making the Best of a Patchy Fossil Record