Cosmological Bounds on Non-Abelian Dark Forces