Deviations from unidirectional anisotropy in layered exchange-bias systems due to breakdown of rigid spin rotations