Rotation and instabilities for isotope and mass separation