Comparison of perturbative and non-perturbative methods in f(R) gravity