Fast Convergence Thanks to Diversity