The analytic structure of amplitudes on backgrounds from gauge invariance and the infra-red