Many-particle limits and non-convergence of dislocation wall pile-ups