Spectra of Operators in Large $N$ Tensor Models