Fast Converging Path Integrals for Time-Dependent Potentials II: Generalization to Many-body Systems and Real-Time Formalism