Living on the edge: how philopatry maintains adaptive potential