Overlooked Trustworthiness of Saliency Maps