Xian Li

发表

On Meaning-Preserving Adversarial Perturbations for Sequence-to-Sequence Models

Graham Neubig, Xian Li, Paul Michel, 2018 .

Efficient Language Modeling with Sparse all-MLP

Myle Ott, Mikel Artetxe, Ping Yu, 2022, ArXiv.

OPT: Open Pre-trained Transformer Language Models

Xi Victoria Lin, Punit Singh Koura, Myle Ott, 2022, ArXiv.

Recipes for Adapting Pre-trained Monolingual and Multilingual Models to Machine Translation

Asa Cooper Stickland, Marjan Ghazvininejad, Xian Li, 2020, EACL.

Few-shot Learning with Multilingual Language Models

Xi Victoria Lin, Punit Singh Koura, Myle Ott, 2021, ArXiv.

Efficient Large Scale Language Modeling with Mixtures of Experts

Xi Victoria Lin, Punit Singh Koura, Myle Ott, 2021, EMNLP.

Few-shot Learning with Multilingual Generative Language Models

Xi Victoria Lin, Punit Singh Koura, Myle Ott, 2021, EMNLP.

ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection

Faisal Ladhak, Zornitsa Kozareva, Asli Celikyilmaz, 2022, EMNLP.

Findings of the First Shared Task on Machine Translation Robustness

Yonatan Belinkov, Nadir Durrani, Graham Neubig, 2019, WMT.

Multilingual Denoising Pre-training for Neural Machine Translation

Marjan Ghazvininejad, Luke Zettlemoyer, Sergey Edunov, 2020, Transactions of the Association for Computational Linguistics.

FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow pdf

Eduard Hovy, Graham Neubig, Xuezhe Ma, 2019, EMNLP.

Lifting the Curse of Multilinguality by Pre-training Modular Transformers

Xi Victoria Lin, Xi Victoria Lin, Naman Goyal, 2022, NAACL.

Cross-lingual Retrieval for Iterative Self-Supervised Training pdf

Yuqing Tang, Chau Tran, Xian Li, 2020, NeurIPS.

On Evaluation of Adversarial Perturbations for Sequence-to-Sequence Models

Graham Neubig, Xian Li, Paul Michel, 2019, NAACL.

Few-shot Learning with Multilingual Generative Language Models

Xi Victoria Lin, Punit Singh Koura, Myle Ott, 2022, EMNLP.

Multilingual Translation with Extensible Multilingual Pretraining and Finetuning pdf

Yuqing Tang, Peng-Jen Chen, Vishrav Chaudhary, 2020, ArXiv.

Multilingual Translation from Denoising Pre-Training

Vishrav Chaudhary, Angela Fan, Naman Goyal, 2021, FINDINGS.

A Corpus for Multilingual Document Classification in Eight Languages pdf

Holger Schwenk, Xian Li, Holger Schwenk, 2018, LREC.

Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs pdf

Zornitsa Kozareva, Asli Celikyilmaz, Veselin Stoyanov, 2021, ArXiv.

Findings of the WMT 2020 Shared Task on Machine Translation Robustness

Yonatan Belinkov, Nadir Durrani, Hassan Sajjad, 2020, WMT.

Unified Speech-Text Pre-training for Speech Translation and Recognition

Michael Auli, Jiatao Gu, J. Pino, 2022, ACL.

Gender bias amplification during Speed-Quality optimization in Neural Machine Translation

Kenneth Heafield, Mona T. Diab, Mona Diab, 2021, ACL.

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

Xi Victoria Lin, Punit Singh Koura, Veselin Stoyanov, 2022, ArXiv.

Improving Zero-Shot Translation by Disentangling Positional Information

J. Niehues, James Cross, Francisco Guzmán, 2020, ACL.

Design and Evaluation of a Social Media Writing Support Tool for People with Dyslexia

Xian Li, Francisco Guzmán, Lindsay Reynolds, 2019, CHI.

Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task pdf

Dmitriy Genzel, Juan Pino, Changhan Wang, 2021, ACL.

Multilingual Speech Translation from Efficient Finetuning of Pretrained Models

Michael Auli, Alexei Baevski, C. Tran, 2020, ACL.

Cross-Modal Transfer Learning for Multilingual Speech-to-Text Translation pdf

Yun Tang, Juan Pino, Changhan Wang, 2020, ArXiv.

Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling pdf

Juan Pino, Hongyu Gong, Yun Tang, 2021, NeurIPS.

ATST: Audio Representation Learning with Teacher-Student Transformer

Xiaofei Li, Xian Li, 2022, INTERSPEECH.

FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task pdf

Juan Pino, Changhan Wang, Naman Goyal, 2021, IWSLT.

Multilingual Neural Machine Translation with Deep Encoder and Multiple Shallow Decoders

Adithya Renduchintala, Jiatao Gu, Xiang Kong, 2022, EACL.

Adaptive Sparse Transformer for Multilingual Translation pdf

Dmitriy Genzel, Hongyu Gong, Xian Li, 2021, ArXiv.

Addressing Posterior Collapse with Mutual Information for Improved Variational Neural Machine Translation

Arya D. McCarthy, Ning Dong, Xian Li, 2020, ACL.

Distributionally Robust Multilingual Machine Translation pdf

Marjan Ghazvininejad, Daniel Levy, Xian Li, 2021, EMNLP.

Large Language Model Programs

J. Schmidhuber, J. Weston, Sainbayar Sukhbaatar, 2023, ArXiv.

Methods for Measuring, Updating, and Visualizing Factual Beliefs in Language Models

Veselin Stoyanov, Mohit Bansal, Zornitsa Kozareva, 2023, EACL.

Robust Optimization for Multilingual Translation with Imbalanced Data

Xian Li, Hongyu Gong, 2021, NeurIPS.

Efficient Large Scale Language Modeling with Mixtures of Experts

Xi Victoria Lin, Punit Singh Koura, Myle Ott, 2022, EMNLP.

Deep Transformers with Latent Depth pdf

Xian Li, Xiang Kong, Asa Cooper Stickland, 2020, NeurIPS.

Few-shot Learning with Multilingual Language Models pdf

Zornitsa Kozareva, Vishrav Chaudhary, Myle Ott, 2021, ArXiv.

Towards A Unified View of Sparse Feed-Forward Network in Pretraining Large Language Model

Xi Victoria Lin, Ves Stoyanov, Xian Li, 2023, Conference on Empirical Methods in Natural Language Processing.

Demystify Optimization Challenges in Multilingual Transformers pdf

Hongyu Gong, Xian Li, Xian Li, 2021, ArXiv.

Multilingual Speech Translation from Efficient Finetuning of Pretrained Models

Michael Auli, Alexei Baevski, C. Tran, 2021, Annual Meeting of the Association for Computational Linguistics.