Time averages of polynomials