Irradiation damage in magnetic insulators