Improving the Reliability for Confidence Estimation