Zihang Dai

发表

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Yiming Yang, Quoc V. Le, Ruslan Salakhutdinov, 2019, NeurIPS.

Unsupervised Data Augmentation pdf

Quoc V. Le, Eduard H. Hovy, Minh-Thang Luong, 2019, ArXiv.

CALIBRATING ENERGY-BASED GENERATIVE ADVER-

Aaron C. Courville, Amjad Almahairi, Zihang Dai, 2017 .

Good Semi-supervised Learning That Requires a Bad GAN pdf

Fan Yang, Ruslan Salakhutdinov, William W. Cohen, 2017, NIPS.

Adversarial Invariant Feature Learning

Graham Neubig, Zihang Dai, E. Hovy, 2017, NIPS 2017.

An Interpretable Knowledge Transfer Model for Knowledge Base Completion

Eduard H. Hovy, Xuezhe Ma, Qizhe Xie, 2017, ACL.

Combined Scaling for Open-Vocabulary Image Classiﬁcation

Quoc V. Le, Adams Wei Yu, Mingxing Tan, 2022 .

Transformer-XL: Language Modeling with Longer-Term Dependency

Yiming Yang, Jaime G. Carbonell, Quoc V. Le, 2018 .

A Mutual Information Maximization Perspective of Language Representation Learning

Cyprien de Masson d'Autume, Dani Yogatama, Lei Yu, 2019, ICLR.

Transformer Quality in Linear Time

Quoc V. Le, Hanxiao Liu, Zihang Dai, 2022, ICML.

Searching for Efficient Transformers for Language Modeling

Quoc V. Le, David R. So, Hanxiao Liu, 2021, NeurIPS.

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

Adams Wei Yu, Zihang Dai, Yuan Cao, 2021, ICLR.

Pay Attention to MLPs pdf

Quoc V. Le, Hanxiao Liu, Zihang Dai, 2021, NeurIPS.

Combined Scaling for Zero-shot Transfer Learning pdf

Quoc V. Le, Adams Wei Yu, Minh-Thang Luong, 2021, ArXiv.

Meta Pseudo Labels

Quoc V. Le, Qizhe Xie, Zihang Dai, 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

CoAtNet: Marrying Convolution and Attention for All Data Sizes pdf

Quoc V. Le, Hanxiao Liu, Mingxing Tan, 2021, NeurIPS.

Breaking the Softmax Bottleneck: A High-Rank RNN Language Model pdf

Ruslan Salakhutdinov, William W. Cohen, Zhilin Yang, 2017, ICLR.

Transformer-XL: Attentive Language Models beyond a Fixed-Length Context

Yiming Yang, Jaime G. Carbonell, Quoc V. Le, 2019, ACL.

Unsupervised Data Augmentation for Consistency Training

Quoc V. Le, Eduard Hovy, Minh-Thang Luong, 2019, NeurIPS.

From Credit Assignment to Entropy Regularization: Two New Algorithms for Neural Sequence Prediction

Eduard H. Hovy, Qizhe Xie, Zihang Dai, 2018, ACL.

Combined Scaling for Zero-shot Transfer Learning

Quoc V. Le, Adams Wei Yu, Mingxing Tan, 2021, Neurocomputing.

SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation

Graham Neubig, Zihang Dai, Hieu Pham, 2018, EMNLP.

Unsupervised Parallel Corpus Mining on Web Data pdf

Guokun Lai, Yiming Yang, Zihang Dai, 2020, ArXiv.

Calibrating Energy-based Generative Adversarial Networks pdf

Philip Bachman, Eduard H. Hovy, Aaron C. Courville, 2017, ICLR.

Three-Dimensional and Threefold Nonlinear Numerical Modeling for Slope-Stabilizing Pile

Zihang Dai, Jianhui Yang, Rui Dai, 2022, KSCE Journal of Civil Engineering.

Characterizing and Avoiding Negative Transfer

Jaime G. Carbonell, Barnabás Póczos, Zihang Dai, 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

Prediction of the sulfate resistance for recycled aggregate concrete based on ensemble learning algorithms

Zihang Dai, Xincong Yang, Kaihua Liu, 2022, Construction and Building Materials.

Primer: Searching for Efficient Transformers for Language Modeling pdf

Quoc V. Le, Hanxiao Liu, Noam Shazeer, 2021, NeurIPS.

Controllable Invariance through Adversarial Feature Learning

Graham Neubig, Eduard H. Hovy, Qizhe Xie, 2017, NIPS.

Combiner: Full Attention Transformer with Sparse Computation Cost pdf

Jure Leskovec, Dale Schuurmans, Hongyu Ren, 2021, NeurIPS.

Wiki-40B: Multilingual Language Model Dataset

Zihang Dai, Rami Al-Rfou, Mandy Guo, 2020, LREC.

Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing pdf

Guokun Lai, Yiming Yang, Quoc V. Le, 2020, NeurIPS.

Recurrent Neural Network

Jürgen Schmidhuber, Zihang Dai, J. Schmidhuber, 2015 .

A Mutual Information Maximization Perspective of Language Representation Learning pdf

Lei Yu, Dani Yogatama, Lingpeng Kong, 2019, ICLR.

Large-scale Cloze Test Dataset Designed by Teachers pdf

Guokun Lai, Eduard H. Hovy, Qizhe Xie, 2018, ArXiv.

Large-scale Cloze Test Dataset Created by Teachers

Guokun Lai, Eduard H. Hovy, Qizhe Xie, 2017, EMNLP.

Fast and Simple Mixture of Softmaxes with BPE and Hybrid-LightRNN for Language Generation

Eduard H. Hovy, Qizhe Xie, Zihang Dai, 2018, AAAI.

Re-examination of the Role of Latent Variables in Sequence Modeling

Guokun Lai, Yiming Yang, Zihang Dai, 2019, NeurIPS.

CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases pdf

Wei Xu, Lei Li, Zihang Dai, 2016, ACL.

Transformer-XL: Language Modeling with Longer-Term Dependency

Quoc V. Le, William W. Cohen, R. Salakhutdinov, 2018 .