Ting Cao

Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models

Shanghang Zhang, Fan Yang, Shanghang Zhang, 2023, ArXiv.

Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference

Yujing Wang, L. Zhang, Yuqing Yang, 2023, Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Jinyu Li, Yu Wu, L. Zhang, 2023, ArXiv.

AFPQ: Asymmetric Floating Point Quantization for LLMs

Shijie Cao, Ting Cao, Yijia Zhang, 2023, 2311.01792.