A Hybrid Vortex Method with Deterministic Diffusion