Non-volatile polarization switch of magnetic domain wall velocity