Liad Ben-Uri

Neural gradients are lognormally distributed: understanding sparse and quantized training pdf

Brian Chmiel, Liad Ben-Uri, Moran Shkolnik, 2020, ArXiv.

Neural gradients are near-lognormal: improved quantized and sparse training

Brian Chmiel, Liad Ben-Uri, Moran Shkolnik, 2020 .

Neural gradients are near-lognormal: improved quantized and sparse training

Brian Chmiel, Liad Ben-Uri, Elad Hoffer, 2020, ICLR.