The time-scale of escape from star clusters