Compactification of dualities with decoupled operators and $3d$ mirror symmetry