Siegel Paramodular Forms from Exponential Lifts: Slow versus Fast Growth