Improved Fine-Tuning by Better Leveraging Pre-Training Data