Noam M. Shazeer

发表

Exploring the Limits of Language Modeling pdf

Yonghui Wu, Oriol Vinyals, Noam Shazeer, 2016, ArXiv.

Image Transformer pdf

Dustin Tran, Lukasz Kaiser, Ashish Vaswani, 2018, ICML.

Mesh-TensorFlow: Deep Learning for Supercomputers

Dustin Tran, Ashish Vaswani, Noam Shazeer, 2018, NeurIPS.

Variational Program Inference

Noam M. Shazeer, G. Harik, 2010, ArXiv.

Tensor2Tensor for Neural Machine Translation

Samy Bengio, Lukasz Kaiser, Ashish Vaswani, 2018, AMTA.

Generating Wikipedia by Summarizing Long Sequences pdf

Lukasz Kaiser, Noam Shazeer, Ben Goodrich, 2018, ICLR.

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Colin Raffel, Noam Shazeer, Wei Li, 2019, J. Mach. Learn. Res..

An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation pdf

Douglas Eck, Andrew M. Dai, Cheng-Zhi Anna Huang, 2018, ArXiv.

Skip-gram Language Modeling Using Sparse Non-negative Matrix Probability Estimation pdf

Joris Pelemans, Noam Shazeer, Ciprian Chelba, 2014, ArXiv.

Music Transformer: Generating Music with Long-Term Structure

Andrew M. Dai, Cheng-Zhi Anna Huang, Monica Dinculescu, 2018, ICLR.

Solving Crossword Puzzles as Probabilistic Constraint Satisfaction

Michael L. Littman, Greg A. Keim, Noam M. Shazeer, 1999, AAAI/IAAI.

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding pdf

Orhan Firat, Zhifeng Chen, Noam Shazeer, 2020, ICLR.

Generating Wikipedia by Summarizing Long Sequences

Peter J. Liu, Lukasz Kaiser, Noam M. Shazeer, 2018, ICLR.

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer pdf

Geoffrey E. Hinton, Quoc V. Le, Azalia Mirhoseini, 2017, ICLR.

Corpora Generation for Grammatical Error Correction

Noam M. Shazeer, Niki Parmar, Shankar Kumar, 2019, NAACL.

Words aren’t enough, their order matters: On the Robustness of Grounding Visual Referring Expressions

Noam M. Shazeer, Llion Jones, Niki Parmar, 2020 .

Music Transformer

Douglas Eck, Andrew M. Dai, Cheng-Zhi Anna Huang, 2018, 1809.04281.

How Much Knowledge Can You Pack into the Parameters of a Language Model?

Colin Raffel, Noam M. Shazeer, Adam Roberts, 2020, EMNLP.

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Noam M. Shazeer, W. Fedus, Barret Zoph, 2021, ArXiv.

ST-MoE: Designing Stable and Transferable Sparse Expert Models

J. Dean, Noam M. Shazeer, W. Fedus, 2022, 2202.08906.

Sparse Non-negative Matrix Language Modeling (EMNLP presentation)

Joris Pelemans, Noam Shazeer, Ciprian Chelba, 2016 .

Large Scale Multi-Domain Multi-Task Learning with MultiModel

Lukasz Kaiser, Ashish Vaswani, Jakob Uszkoreit, 2018 .

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Noam M. Shazeer, W. Fedus, Barret Zoph, 2021, J. Mach. Learn. Res..

Searching for Efficient Transformers for Language Modeling

Quoc V. Le, David R. So, Hanxiao Liu, 2021, NeurIPS.

Attention is All you Need pdf

Lukasz Kaiser, Ashish Vaswani, Jakob Uszkoreit, 2017, NIPS.

PaLM: Scaling Language Modeling with Pathways

Andrew M. Dai, Hyung Won Chung, Thanumalayan Sankaranarayana Pillai, 2022, J. Mach. Learn. Res..

LaMDA: Language Models for Dialog Applications

Renelito Delos Santos, Noam M. Shazeer, R. Kurzweil, 2022, ArXiv.

HydraNets: Specialized Dynamic Architectures for Efficient Inference

Noam Shazeer, William R. Mark, Kayvon Fatahalian, 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

One Model To Learn Them All pdf

Lukasz Kaiser, Ashish Vaswani, Jakob Uszkoreit, 2017, ArXiv.

GSPMD: General and Scalable Parallelization for ML Computation Graphs pdf

Noam Shazeer, Dehao Chen, Yonghui Wu, 2021, ArXiv.

A probabilistic approach to solving crossword puzzles

Michael L. Littman, Greg A. Keim, Noam M. Shazeer, 2002, Artif. Intell..

GLU Variants Improve Transformer pdf

Noam Shazeer, Noam M. Shazeer, 2020, ArXiv.

Adafactor: Adaptive Learning Rates with Sublinear Memory Cost pdf

Noam Shazeer, Mitchell Stern, Noam M. Shazeer, 2018, ICML.

Blockwise Parallel Decoding for Deep Autoregressive Models

Jakob Uszkoreit, Noam Shazeer, Mitchell Stern, 2018, NeurIPS.

Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks

Samy Bengio, Navdeep Jaitly, Oriol Vinyals, 2015, NIPS.

Faster Transformer Decoding: N-gram Masked Self-Attention pdf

Ankur Bapna, Noam Shazeer, Ciprian Chelba, 2020, ArXiv.

Do Transformer Modifications Transfer Across Implementations and Applications?

Hyung Won Chung, Colin Raffel, Noam M. Shazeer, 2021, EMNLP.

Scaling Up Models and Data with t5x and seqio

Marc van Zee, Hyung Won Chung, Daniel H Garrette, 2022, ArXiv.

Designing Effective Sparse Expert Models

J. Dean, Noam M. Shazeer, W. Fedus, 2022, 2022 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).

Primer: Searching for Efficient Transformers for Language Modeling pdf

Quoc V. Le, Hanxiao Liu, Noam Shazeer, 2021, NeurIPS.

Talking-Heads Attention pdf

Noam Shazeer, Le Hou, Nan Ding, 2020, ArXiv.

End-to-end text-dependent speaker verification

Georg Heigold, Samy Bengio, Noam Shazeer, 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

Fast Transformer Decoding: One Write-Head is All You Need pdf

Noam Shazeer, Noam M. Shazeer, 2019, ArXiv.

Fast Decoding in Sequence Models using Discrete Latent Variables

Aurko Roy, Samy Bengio, Ashish Vaswani, 2018, ICML.

NN-Grams: Unifying Neural Network and n-Gram Language Models for Speech Recognition

Shankar Kumar, Noam Shazeer, Antoine Bruguier, 2016, INTERSPEECH.

An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation

Andrew M. Dai, Cheng-Zhi Anna Huang, Ashish Vaswani, 2018, ArXiv.

PROVERB: The Probabilistic Cruciverbalist

Karl Weinmeister, Fan Jiang, Michael L. Littman, 1999, AAAI/IAAI.

MULTITuDE: Large-Scale Multilingual Machine-Generated Text Detection Benchmark

Ona de Gibert, David Ifeoluwa Adelani, M Saiful Bari, 2023, ArXiv.

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Peter J. Liu, Colin Raffel, Noam M. Shazeer, 2019, J. Mach. Learn. Res..

End-to-end text-dependent speaker verification

Samy Bengio, Noam M. Shazeer, G. Heigold, 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

High Resolution Medical Image Analysis with Spatial Partitioning pdf

Travis M. Drucker, Noam Shazeer, Panagiotis Korfiatis, 2019, ArXiv.

Zero-Shot Visual Grounding of Referring Utterances in Dialogue Anonymous ACL

Noam M. Shazeer, Thomas Unterthiner, Niki Parmar, 2021 .

Maximum Proxy-Likelihood Estimation for Non-autoregressive Machine Translation

Myle Ott, David Grangier, F. Seide, 2021 .

GeDi: Generative Discriminator Guided Decoding for Faster Controllable Sequence Generation

Teven Le Scao, Patrick von Platen, R. Socher, 2021 .

Cooperative Semi-Supervised Transfer Learning of Machine Reading Comprehension

Sina J. Semnani, Noam M. Shazeer, Réjean Ducharme, 2021 .

One-Step Diffusion Distillation via Deep Equilibrium Models

Siddhant M. Jayakumar, J. Z. Kolter, Raphael Lopez Kaufman, 2023, NeurIPS.

T ailor : Generating and Perturbing Text with Semantic Controls

Ankur P. Parikh, Amrith Rajagopal Setlur, Yinhan Liu, 2021 .

Is Cross-lingual Evaluation Only About Cross-lingual?

Daniel H Garrette, Noam M. Shazeer, Pranav Rajpurkar, 2021 .

FarFetched: An Entity-centric Approach for Reasoning on Textually Represented Environments

Noam M. Shazeer, Nikita Nangia, Sharan Narang, 2021 .

Commonsense Reasoning for Conversational AI: A Survey of Recent Datasets and Benchmarks

Varun R. Embar, L. Getoor, Noam M. Shazeer, 2022 .

Supplementary Materials for: Motion Guided Region Message Passing for Video Captioning

Noam M. Shazeer, Niki Parmar, Yu-Gang Jiang, 2021 .

BotsTalk: Machine-Sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Datasets

Yinhan Liu, Myle Ott, Naman Goyal, 2021 .

When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

Mitesh M. Khapra, Isabel M. Kloumann, Niladri S. Chatterji, 2024, ArXiv.