Random anisotropy models in the Ising limit