Symmetric representations of knot groups