The impact of cosmic variance on simulating weak lensing surveys