Damai Dai

发表

Mixture of Experts for Biomedical Question Answering

Damai Dai, Wen-Jie Jiang, Jiyuan Zhang, 2022, ArXiv.

Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances

Damai Dai, Zhifang Sui, Baobao Chang, 2022, IJCAI.

On the Representation Collapse of Sparse Mixture of Experts

Li Dong, Furu Wei, Shuming Ma, 2022, NeurIPS.

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers

Li Dong, Furu Wei, Damai Dai, 2023, Annual Meeting of the Association for Computational Linguistics.

A Survey for In-context Learning

Damai Dai, Zhifang Sui, Baobao Chang, 2023, ArXiv.

Calibrating Factual Knowledge in Pretrained Language Models

Lei Li, Damai Dai, Zhifang Sui, 2022, EMNLP.

Neural Knowledge Bank for Pretrained Transformers

Damai Dai, Wen-Jie Jiang, Yajuan Lyu, 2022, NLPCC.

Learning to Control the Fine-grained Sentiment for Story Ending Generation

Zhifang Sui, Baobao Chang, Pengcheng Yang, 2019, ACL.

Knowledge Neurons in Pretrained Transformers

Li Dong, Furu Wei, Damai Dai, 2021, ACL.

StableMoE: Stable Routing Strategy for Mixture of Experts

Li Dong, Bo Zheng, Furu Wei, 2022, ACL.

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers

Li Dong, Furu Wei, Damai Dai, 2023, ACL.

Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning

Hao Zhou, Lei Li, Hao Zhou, 2023, EMNLP.

A Survey for In-context Learning

Damai Dai, Zhifang Sui, Baobao Chang, 2022, ArXiv.

Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension pdf

Zhifang Sui, Damai Dai, Baobao Chang, 2021, ArXiv.

Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers

Li Dong, Furu Wei, Shuming Ma, 2022, 2212.10559.

Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions pdf

Hua Zheng, Pengcheng Yang, Baobao Chang, 2020, REPL4NLP.

A Survey on In-context Learning

Damai Dai, Zhifang Sui, Baobao Chang, 2022, 2301.00234.

Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification

Zhifang Sui, Tianyu Liu, Damai Dai, 2021, CIKM.

Bi-Drop: Generalizable Fine-tuning for Pre-trained Language Models via Adaptive Subnetwork Optimization

Yunbo Cao, Damai Dai, Zhifang Sui, 2023, ArXiv.

LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts

Xu Sun, Furu Wei, Shuming Ma, 2018, AAAI.

Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation

Zhifang Sui, Tianyu Liu, Yang Liu, 2021, NAACL.

Sememe Prediction: Learning Semantic Knowledge from Unstructured Textual Wiki Descriptions pdf

Xu Sun, Houfeng Wang, Wei Li, 2018, ArXiv.

Live Video Comment Generation Based on Surrounding Frames and Live Comments pdf

Damai Dai, Damai Dai, 2018, ArXiv.

Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation

Hua Zheng, Tianyu Liu, Yang Liu, 2021, EMNLP.

Explicit Interaction Network for Aspect Sentiment Triplet Extraction pdf

Houfeng Wang, Zhifang Sui, Peiyi Wang, 2021, ArXiv.

Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization

Yunbo Cao, Damai Dai, Zhifang Sui, 2023, EMNLP.

Calibrating Factual Knowledge in Pretrained Language Models

Lei Li, Damai Dai, Zhifang Sui, 2022, EMNLP.

Not All Demonstration Examples are Equally Beneficial: Reweighting Demonstration Examples for In-Context Learning

Damai Dai, Zhifang Sui, Peiyi Wang, 2023, EMNLP.

Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations

Damai Dai, Zhifang Sui, Peiyi Wang, 2023, ACL.

M ATH -S HEPHERD : A L ABEL -F REE S TEP - BY -S TEP V ERIFIER FOR LLM S IN M ATHEMATICAL R EASONING

Damai Dai, Zhifang Sui, Peiyi Wang, 2022 .

Moving the Eiffel Tower to ROME: Tracing and Editing Facts in GPT

Nicola De Cao, Daniel M. Ziegler, T. Henighan, 2021 .

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Yu Wu, Damai Dai, Bo Zhang, 2024, ArXiv.

Exploring Activation Patterns of Parameters in Language Models

Damai Dai, Yudong Wang, Zhifang Sui, 2024, 2405.17799.

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

Yu Wu, Damai Dai, Zhifang Sui, 2024, ArXiv.

Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion

Yunbo Cao, Damai Dai, Zhifang Sui, 2023, ACL.