The spectra of gravitational atoms