Moduli corrections to D-term inflation