Marginal deformations of 3d supersymmetric U(N) model and broken higher spin symmetry