Genetic load has potential in large populations but is realized in small inbred populations