Noise and Epigenetic Inheritance of Single-Cell Division Times Influence Population Fitness