Lorentz-Violating Vector Fields Slow the Universe Down