Kac-Moody symmetries of critical ground states