Multimode instability prediction method