Inversion of analytically perturbed linear operators that are singular at the origin