Toward Human-AI Alignment in Large-Scale Multi-Player Games