Effects of impurity scattering in metallic spin glasses