No Free Lunch in Self Supervised Representation Learning