Stability in $L^1$ of circular vortex patches