On the range of validity of the dipole picture