Perturbative Unitarity Constraints on Gauge Portals