Higher spins and matter interacting in dimension three