Off-shell structure of the string sigma model