Zhihao Shu

EdgeQAT: Entropy and Distribution Guided Quantization-Aware Training for the Acceleration of Lightweight LLMs on the Edge

Wei Niu, Peiyan Dong, Xuan Shen, 2024, ArXiv.