Non-Abelian holonomic transformation in the presence of classical noise