Time-delayed feedback is exploited for controlling noise-induced motion in coherence resonance oscillators. Namely, under the proper choice of time delay, one can either increase or decrease the regularity of motion. It is shown that in an excitable system, delayed feedback can stabilize the frequency of oscillations against variation of noise strength. Also, for fixed noise intensity, the phenomenon of entrainment of the basic oscillation period by the delayed feedback occurs. This allows one to steer the time scales of noise-induced motion by changing the time delay.