Wei Shen

Secrets of RLHF in Large Language Models Part I: PPO

Cheng Chang, Xipeng Qiu, Xuanjing Huang, 2023, ArXiv.

LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment

Tao Gui, Xiao Wang, Shihan Dou, 2023, ArXiv.

Improving Generalization of Alignment with Human Preferences through Group Invariant Learning

Tao Gui, Xiao Wang, Shihan Dou, 2023, ICLR.

Secrets of RLHF in Large Language Models Part II: Reward Modeling

Zuxuan Wu, Tao Gui, Xiao Wang, 2024, ArXiv.

Human-Instruction-Free LLM Self-Alignment with Limited Samples

Jiaheng Wei, Yuanshun Yao, Wei Shen, 2024, ArXiv.