Enable Language Models to Implicitly Learn Self-Improvement From Data