Kenneth Q Ye

Large Models are Parsimonious Learners: Activation Sparsity in Trained Transformers

Sashank J. Reddi, Felix X. Yu, Srinadh Bhojanapalli, 2022, ArXiv.

Representational oligonucleotide microarray analysis: a high-resolution method to detect genome copy number variation.

J. Sebat, J. Troge, M. Wigler, 2003, Genome research.

The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers

Sashank J. Reddi, Srinadh Bhojanapalli, Ruiqi Guo, 2022, ICLR.