Spectral Structure of Sets of Integers