Ido Hakimi

DANA: Scalable Out-of-the-box Distributed ASGD Without Retuning

Assaf Schuster, Moshe Gabel, Ido Hakimi, 2018 .

Taming Momentum in a Distributed Asynchronous Environment pdf

Assaf Schuster, Moshe Gabel, Ido Hakimi, 2019, ArXiv.

Gap Aware Mitigation of Gradient Staleness pdf

Assaf Schuster, Ido Hakimi, Saar Barkai, 2020, ICLR.

Learning Under Delayed Feedback: Implicitly Adapting to Gradient Delays pdf

Assaf Schuster, Kfir Y. Levy, Ido Hakimi, 2021, ArXiv.

Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism

Assaf Schuster, Mark Silberstein, Ido Hakimi, 2021, USENIX Annual Technical Conference.

Asynchronous Distributed Learning : Adapting to Gradient Delays without Prior Knowledge

Assaf Schuster, Ido Hakimi, Rotem Zamir Aviv, 2021, ICML.