Vortex annihilation and inverse cascades in two dimensional superfluid turbulence