Renormalizing the vacuum energy in cosmological spacetime: implications for the cosmological constant problem