Diffuse Surface Scattering and Quantum Size Effects in the Surface Plasmon Resonances of Low Carrier Density Nanocrystals