Flat space (higher spin) gravity with chemical potentials