Xinhao Cheng

SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification

Zhihao Jia, G. Oliaro, Xupeng Miao, 2023, ArXiv.

SpecInfer: Accelerating Generative Large Language Model Serving with Speculative Inference and Token Tree Verification

Zhihao Jia, G. Oliaro, Xiaoxiang Shi, 2023 .

Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems

Hongyi Jin, Zhihao Zhang, Xinhao Cheng, 2023, ArXiv.