Vortex Annihilation Dependence of Chirality in Asymmetric Permalloy Dots