Anyons and the double copy