A Study on Robustness to Perturbations for Representations of Environmental Sound