Systematic study of carrier correlations in the electron-hole recombination dynamics of quantum dots