Flexible boundary conditions and nonlinear geometric effects in atomic dislocation modeling