Dynamic Change of Genetic Diversity in Conserved Populations with Different Initial Genetic Architectures