On the extinction of sub-populations on multimodal landscapes