Paying More Attention to Saliency