论文信息 - DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining - 字舞流文

DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining

Sang Michael Xie | Sang Michael Xie | Quoc V. Le | Percy Liang | Hieu Pham | Hanxiao Liu | Yifeng Lu | Nan Du | Tengyu Ma | Xuanyi Dong | A. Yu