An experimental study of unstable barotropic vortices in a rotating fluid