Attending to Contrast