Removability of exceptional sets for differentiable and Lipschitz functions