Moduli of representations of the fundamental group of a smooth projective variety. II