The effect of binaries on the space velocity distribution of single pulsars