Quantifying the eddy diffusivity of the Southern Ocean II : spatial variability and the role of the mean flow