Factorization of colored knot polynomials at roots of unity