Late-formed halos prefer to host quiescent central galaxies. I. Observational results