The unitary Fermi gas at large charge and large N