Observation-based correction of dynamical models using thermostats