论文信息 - Joint-training on Symbiosis Networks for Deep Nueral Machine Translation models

Joint-training on Symbiosis Networks for Deep Nueral Machine Translation models

Translation models Zhengzhe Yu1, Jiaxin Guo1, Minghan Wang1, Daimeng Wei1, Hengchao Shang1, Zongyao Li1, Zhanglin Wu1, Yuxia Wang2, Yimeng Chen1, Chang Su1, Min Zhang1, Lizhi Lei1, Shimin Tao1, Hao Yang1 1Huawei Translation Services Center, Beijing, China 2The University of Melbourne, Melbourne, Australia {yuzhengzhe,guojiaxin1,wangminghan,weidaimeng,shanghengchao, lizongyao,wuzhanglin2,chenyimeng,suchang8,zhangmin186, leilizhi,taoshimin,yanghao30}@huawei.com yuxiaw@student.unimelb.edu.au Abstract

[1] Yoshua Bengio,et al. Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[2] Jingbo Zhu,et al. Shallow-to-Deep Training for Neural Machine Translation , 2020, EMNLP.

[3] Jingbo Zhu,et al. Learning Deep Transformer Models for Machine Translation , 2019, ACL.

[4] Lukasz Kaiser,et al. Attention is All you Need , 2017, NIPS.

[5] George Kurian,et al. Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.

[6] Rico Sennrich,et al. Neural Machine Translation of Rare Words with Subword Units , 2015, ACL.

[7] Quoc V. Le,et al. Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[8] Edouard Grave,et al. Reducing Transformer Depth on Demand with Structured Dropout , 2019, ICLR.

[9] Jimmy Ba,et al. Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10] Ashish Vaswani,et al. Self-Attention with Relative Position Representations , 2018, NAACL.

[11] Zhoujun Li,et al. Smart-Start Decoding for Neural Machine Translation , 2021, NAACL.

[12] Philipp Koehn,et al. Moses: Open Source Toolkit for Statistical Machine Translation , 2007, ACL.

[13] Salim Roukos,et al. Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[14] Myle Ott,et al. fairseq: A Fast, Extensible Toolkit for Sequence Modeling , 2019, NAACL.