On the spectrum of the Thue-Morse quasicrystal and the rarefaction phenomenon