Is adaptation to climate change really constrained in niche specialists?