Asymptotic spectrum of Kerr black holes in the small angular momentum limit