Symmetry properties of higher numerical ranges