A fundamental experimental and numerical study of large-scale morphodynamics in steady and oscillatory flows