Spectral asymptotic behavior of a class of integral operators