Symmetry of anomalous dimension matrices explained