Commutators in the two scalar and matrix weighted setting