On the average distance property of spheres in Banach spaces