Infrared Pump-Probe Spectroscopy of Plasmons in Graphene and Semiconductors