Dynamically restoring conformal invariance in (integrable) $\sigma$-models