Modulation of ENSO variability on decadel and longer timescales