Gradient estimates below the duality exponent