Covariant Eective Field Theory of Gravity I: Formalism and Curvature expansion