Katherine Lee

发表

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Colin Raffel, Noam Shazeer, Wei Li, 2019, J. Mach. Learn. Res..

PaLM: Scaling Language Modeling with Pathways

Andrew M. Dai, Hyung Won Chung, Thanumalayan Sankaranarayana Pillai, 2022, J. Mach. Learn. Res..

WT5?! Training Text-to-Text Models to Explain their Predictions pdf

Colin Raffel, Sharan Narang, Adam Roberts, 2020, ArXiv.

Propagation of information along the cortical hierarchy as a function of attention while reading and listening to stories

Uri Hasson, Erez Simony, Katherine Lee, 2018, bioRxiv.

Hallucinations in Neural Machine Translation

Ashish Agarwal, Orhan Firat, Katherine Lee, 2018 .

Extracting Training Data from Large Language Models

Colin Raffel, Dawn Song, Eric Wallace, 2020, USENIX Security Symposium.

Measuring Forgetting of Memorized Training Examples

Florian Tramèr, Nicolas Papernot, Nicholas Carlini, 2022, ICLR.

Deduplicating Training Data Makes Language Models Better

Nicholas Carlini, Chiyuan Zhang, Chris Callison-Burch, 2021, ACL.

PaLM 2 Technical Report

Andrew M. Dai, Jan A. Botha, Laurent El Shafey, 2023, ArXiv.

Quantifying Memorization Across Neural Language Models

Florian Tramèr, Nicholas Carlini, Chiyuan Zhang, 2022, ICLR.

Counterfactual Memorization in Neural Language Models pdf

Daphne Ippolito, Nicholas Carlini, Florian Tramer, 2021, ArXiv.

What Does it Mean for a Language Model to Preserve Privacy?

Florian Tramèr, R. Shokri, Katherine Lee, 2022, FAccT.

Students Parrot Their Teachers: Membership Inference on Model Distillation

Christopher A. Choquette-Choo, Nicholas Carlini, Katherine Lee, 2023, ArXiv.

Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy

Christopher A. Choquette-Choo, Florian Tramèr, Nicholas Carlini, 2022, ArXiv.

Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy

Christopher A. Choquette-Choo, Florian Tramèr, Nicholas Carlini, 2022, ArXiv.

A Pretrainer’s Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity

Barret Zoph, Adam Roberts, Denny Zhou, 2023, NAACL.

Propagation of information along the cortical hierarchy as a function of attention while reading and listening to stories

Uri Hasson, Erez Simony, Kean Ming Tan, 2018, bioRxiv.

Q UANTIFYING M EMORIZATION A CROSS N EURAL L ANGUAGE M ODELS

Florian Tramèr, Nicholas Carlini, Katherine Lee, 2023 .

Are aligned neural networks adversarially aligned?

Pang Wei Koh, Christopher A. Choquette-Choo, Florian Tramèr, 2023, NeurIPS.

M EASURING F ORGETTING OF M EMORIZED T RAINING E XAMPLES

Florian Tramèr, Nicolas Papernot, Nicholas Carlini, 2023 .

Security of Machine Learning

Florian Tramèr, Nicholas Carlini, D. Song, 2019 .

PaLM 2 Technical Report

Andrew M. Dai, Jan A. Botha, Laurent El Shafey, 2023, ArXiv.

Extracting Training Data from Large Language Models

Tom B. Brown, Florian Tramèr, Nicholas Carlini, 2020, USENIX Security Symposium.

Counterfactual Memorization in Neural Language Models

Florian Tramèr, Nicholas Carlini, Katherine Lee, 2021, NeurIPS.

Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of Privacy

Florian Tramèr, Nicholas Carlini, Katherine Lee, 2022, INLG.

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Peter J. Liu, Colin Raffel, Noam M. Shazeer, 2019, J. Mach. Learn. Res..

PaLM 2 Technical Report

Andrew M. Dai, Jan A. Botha, Laurent El Shafey, 2023, ArXiv.

Scalable Extraction of Training Data from (Production) Language Models

Christopher A. Choquette-Choo, Florian Tramèr, Nicholas Carlini, 2023, ArXiv.