Accurate modeling of intermediate-mass-ratio inspirals: exploring the form of the self-force in the intermediate-mass-ratio regime