Mutation and the $\eta$-invariant