On the use of symmetry to simplify the constitutive equations of isotropic materials with memory