The evolution of vortices in vertical shear. II: Large‐scale asymmetries