Fermions Acting on Quasi-local Operators in the XXZ Model