The cosmological unimportance of low surface brightness galaxies