Geometry, topology, and physics of non-Abelian lattices