A novel mechanism for the decay of neutron star magnetic fields