Naturalistic E-Scooter Maneuver Recognition with Federated Contrastive Rider Interaction Learning