Friction of the surface plasmon by high-energy particle-hole pairs