Effect of small perturbations on the evolution of polycrystalline structure during plastic deformation