Stability of the local gamma factor in the unitary case