Spectral properties of the Brownian self-transport operator