Symmetries of perturbed conformal field theories