Bargmann invariants and off-diagonal geometric phases for multilevel quantum systems: A unitary-group approach