Shift Invariance Can Reduce Adversarial Robustness