Optimal convergence rates of totally asynchronous optimization