The Build-Up of Diversity in Complex Ecosystems