How a student becomes a teacher: learning and forgetting through Spectral methods