Role of saddles in mean-field dynamics above the glass transition