Artificial selection with differing population structures