Cosmological dark matter annihilations into γ rays: A closer look