The Hubble diagram as a probe of mini-charged particles