Bandwidth limitation and distinct operating regimes of passively mode-locked dye lasers using strong phase shaping