Dark matter vs. neutrinos: the effect of astrophysical uncertainties and timing information on the neutrino floor