Asymmetric transverse momentum broadening in an inhomogeneous medium