Modulations of the surface magnetic field on the intra-cycle variability of total solar irradiance